-- Logs begin at Thu 2022-06-16 13:59:27 UTC, end at Thu 2022-06-16 15:19:49 UTC. -- Jun 16 14:40:15.644790 dv-cinder-837353-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 14:40:15.659554 dv-cinder-837353-2-smb devstack@keystone.service[80097]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 14:40:15.661221 dv-cinder-837353-2-smb devstack@keystone.service[80097]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 14:40:15 2022] *** Jun 16 14:40:15.661221 dv-cinder-837353-2-smb devstack@keystone.service[80097]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 14:40:15.661221 dv-cinder-837353-2-smb devstack@keystone.service[80097]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 14:40:15.661221 dv-cinder-837353-2-smb devstack@keystone.service[80097]: nodename: dv-cinder-837353-2-smb Jun 16 14:40:15.661221 dv-cinder-837353-2-smb devstack@keystone.service[80097]: machine: x86_64 Jun 16 14:40:15.661221 dv-cinder-837353-2-smb devstack@keystone.service[80097]: clock source: unix Jun 16 14:40:15.661221 dv-cinder-837353-2-smb devstack@keystone.service[80097]: pcre jit disabled Jun 16 14:40:15.661221 dv-cinder-837353-2-smb devstack@keystone.service[80097]: detected number of CPU cores: 4 Jun 16 14:40:15.661221 dv-cinder-837353-2-smb devstack@keystone.service[80097]: current working directory: / Jun 16 14:40:15.661221 dv-cinder-837353-2-smb devstack@keystone.service[80097]: detected binary path: /usr/bin/uwsgi-core Jun 16 14:40:15.661221 dv-cinder-837353-2-smb devstack@keystone.service[80097]: your processes number limit is 47680 Jun 16 14:40:15.661789 dv-cinder-837353-2-smb devstack@keystone.service[80097]: your memory page size is 4096 bytes Jun 16 14:40:15.661789 dv-cinder-837353-2-smb devstack@keystone.service[80097]: detected max file descriptor number: 2048 Jun 16 14:40:15.661789 dv-cinder-837353-2-smb devstack@keystone.service[80097]: lock engine: pthread robust mutexes Jun 16 14:40:15.661789 dv-cinder-837353-2-smb devstack@keystone.service[80097]: thunder lock: enabled Jun 16 14:40:15.661789 dv-cinder-837353-2-smb devstack@keystone.service[80097]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 14:40:15.661789 dv-cinder-837353-2-smb devstack@keystone.service[80097]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 14:40:15.705962 dv-cinder-837353-2-smb devstack@keystone.service[80097]: Python main interpreter initialized at 0x564b764ae9c0 Jun 16 14:40:15.705962 dv-cinder-837353-2-smb devstack@keystone.service[80097]: python threads support enabled Jun 16 14:40:15.705962 dv-cinder-837353-2-smb devstack@keystone.service[80097]: your server socket listen backlog is limited to 100 connections Jun 16 14:40:15.705962 dv-cinder-837353-2-smb devstack@keystone.service[80097]: your mercy for graceful operations on workers is 90 seconds Jun 16 14:40:15.706309 dv-cinder-837353-2-smb devstack@keystone.service[80097]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 14:40:15.706386 dv-cinder-837353-2-smb devstack@keystone.service[80097]: *** Operational MODE: preforking *** Jun 16 14:40:15.706654 dv-cinder-837353-2-smb devstack@keystone.service[80097]: *** uWSGI is running in multiple interpreter mode *** Jun 16 14:40:15.706654 dv-cinder-837353-2-smb devstack@keystone.service[80097]: spawned uWSGI master process (pid: 80097) Jun 16 14:40:15.706852 dv-cinder-837353-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 14:40:15.707596 dv-cinder-837353-2-smb devstack@keystone.service[80097]: spawned uWSGI worker 1 (pid: 80108, cores: 1) Jun 16 14:40:15.709726 dv-cinder-837353-2-smb devstack@keystone.service[80097]: spawned uWSGI worker 2 (pid: 80109, cores: 1) Jun 16 14:40:15.709726 dv-cinder-837353-2-smb devstack@keystone.service[80097]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 14:40:21.250086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:40:21.250086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: from cryptography.utils import int_from_bytes Jun 16 14:40:21.250954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:40:21.250954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: from cryptography.utils import int_from_bytes Jun 16 14:40:21.252148 dv-cinder-837353-2-smb devstack@keystone.service[80109]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:40:21.252148 dv-cinder-837353-2-smb devstack@keystone.service[80109]: from cryptography.utils import int_from_bytes Jun 16 14:40:21.252621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:40:21.252621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: from cryptography.utils import int_from_bytes Jun 16 14:40:21.300656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:40:21.300853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:40:21.301052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] command line args: [] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:40:21.301269 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:40:21.301352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:40:21.301475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:40:21.301561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ================================================================================ {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:40:21.301676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] command line args: [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:40:21.301756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] admin_token = **** {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.301986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:40:21.302079 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] config_dir = [] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.302164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ================================================================================ {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:40:21.302242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.302342 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] config_source = [] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.302425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] admin_token = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.302523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] debug = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.302659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] config_dir = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.302744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.302974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.303039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] config_source = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.303095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.303222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] debug = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.303336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.303434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.303560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.303657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.303758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.303869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.303971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] list_limit = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.304066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.304162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] log_config_append = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.304256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.304364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.304467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] log_dir = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.304568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.304669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] log_file = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.304771 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] log_config_append = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.304872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.304985 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.305072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] log_dir = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.305189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.305263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] log_file = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.305378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.305459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.305542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.305664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.305740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.305862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.305956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.306083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.306211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.306329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.306411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.306563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.306645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.306796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.306875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.307113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.307260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.307339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.307505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.307626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.307740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.307826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.307977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.308098 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.308251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.308485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.308566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.308665 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] publish_errors = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.308801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.308881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.309113 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.309290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.309370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.309499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] publish_errors = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.309575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.309690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.309770 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.309932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.310039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] standard_threads = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.310125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.310232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.310354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.310475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.310602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.310678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.310810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] use_journal = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.310886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] standard_threads = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.310983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] use_json = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.311062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.311141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] use_stderr = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.311266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.311343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] use_syslog = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.311443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.311522 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.311646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] use_journal = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.311778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.311864 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] use_json = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.311990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] use_stderr = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.312075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.312168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] use_syslog = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.312258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.312405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:40:21.312490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.312677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.312775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.312973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.313059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.313220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.313467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.313550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.313628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.313705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.313785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.313948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.314030 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.314203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.314291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.314437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.314523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.314683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.314761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.314921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.315005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.315168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.315256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.315408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.315485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.315651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.315792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.315926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.316165 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.316273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.316389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.316468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.316630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.316714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.316914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.316995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.317174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.317251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.317465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.317575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.317678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.317758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.317959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.318091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.318191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.318287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.318423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.318538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.318656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.318768 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.318896 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.319031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.319146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.319260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.319395 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.319499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.319628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.319761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.319860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.320015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.320107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.320275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.320353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.320520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.320597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.320756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.320829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.321028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.321106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.321262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.321340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.321495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.321580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.321725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.321803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.322001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.322102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.322183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.322269 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.322415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.322536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.322654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.322771 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.322905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.323027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.323137 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.323263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.323374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.323521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.323598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.323767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.323852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.324020 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.324107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.324277 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.324356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.324511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.324637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.324771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.324861 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.324968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.325048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.325204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.325283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.325422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.325570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.325677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.325836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.325985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.326139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.326246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.326397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.326538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.326680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.326790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.326926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.327012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.327143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.327229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.327303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.327430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.327546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.327622 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.327737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.327858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.327945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.328117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.328219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.328354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.329013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.329300 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.329434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.329511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.329632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.329742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.329955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.330039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.330207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.330330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.330451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.330531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.330689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.330766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.330926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.331007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.331167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.331288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.331399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.331627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.331720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.331860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.331987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.332093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.332327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.332415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.332587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.332666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.332825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.332904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.333065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.333151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.333299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.333380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.333539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.333619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.333774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.333862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.334031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.334136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.334265 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.334401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.334479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.334668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.334749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.334927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.335005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.335162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.335241 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.335390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.335480 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.335630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.335712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.335866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.335954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.336119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.336199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.336354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.336434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.336591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.336675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.336831 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.336909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.337066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.337146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.337363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] auth.external = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.337456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.337616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.337701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.337788 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.337862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.338093 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.338203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.338279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.338364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] auth.password = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.338468 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.338549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] auth.token = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.338711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.338789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.338949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.339035 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.339194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.339282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.339422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.339503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.339668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.339748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.339913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.339992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.external = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.340142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.340223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.340378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] credential.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.340459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.340630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.340773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.340864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.340942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.password = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.341112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.341196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.token = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.341344 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.341431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.341585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.341663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.341817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.341922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.342090 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.342185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.342342 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.342420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.342578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.342656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.342812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.342899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.343056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.343133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.343307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.343384 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.343561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.343646 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.343806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.343882 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.344706 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.344867 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.344966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] federation.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.345206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.345285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.345453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.345532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.345700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.345778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.345951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.346034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.346207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.346285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.346444 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.346521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.346699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.346780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.346935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.347019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.347190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.347268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.347426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.347506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.347673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.347751 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.347910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.347993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.348157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.348237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.348404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.348483 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.348641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.348719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.348878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.348957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.349125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.349203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.349355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.349433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.349579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.349654 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.349827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.349933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.350101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.350189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.350333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.350412 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.350561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.350645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.350791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.350876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.351054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.351131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.351281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.351372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.351526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.351613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.351776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.351858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.352021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.352097 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.352256 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.352340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.352499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.352577 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.352739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.352970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.353061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.353204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.353282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.353434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.353512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.353666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.353749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.353917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.354007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.354158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.354236 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.354405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.354490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.354635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.354802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.354886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.355104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.355182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.355337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.355415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.355582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.355659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.355830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.355908 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.356059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.356137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.356295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.356372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.356522 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.356606 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.356757 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.356836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.356990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.357068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.357228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.357305 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.357462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.357541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.357695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.357772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.357962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.358042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.358211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.358290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.358439 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.358517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.358667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.358745 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.358915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.359002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.359161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.359244 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.359395 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.359477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.359626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.359721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.360169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.360461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.360461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.360616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.360686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.360747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.360804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.360924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.361010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.361160 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.361247 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.361409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.361519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.361656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.361758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.361931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.362028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.362159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.362259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.362390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.362512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.362625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.362756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.362859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.362997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.363095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.363238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.363325 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.363476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.363555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.363720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.363798 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.363985 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.364071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.364222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.364301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.364475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.364551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.364701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.364790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.364948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.365027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.365183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.365261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.365415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.365500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.365650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.365728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.365900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.365981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.366144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.366234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.366390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.366467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.366623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.366700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.366875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.366961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.367104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.367182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.367347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.367424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.367580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.367666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.367816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.367894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.368049 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.368128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.368294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.368380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.368532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.368608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.368759 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.368835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.368994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.369123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.369233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] resource.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.369312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.369482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.369560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.369733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.369852 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.369980 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.370092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.370227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.370331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.370476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.370606 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.370714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.370850 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.370959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.371093 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.371193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.371334 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.371414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.371587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.371664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] role.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.371833 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.371910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] role.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.372070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.372149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.372312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.372390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.372560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.372638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.372806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.372886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.373050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.373128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.373289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.373366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.373531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.373609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.373774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.373852 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.374043 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.374123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.374275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.374353 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.374521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.374598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.374766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.374844 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.375007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] role.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.375085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.375430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.375536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] role.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.375611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.375786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.375867 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.376058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.376136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.376313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.376390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.376559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.376638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.376807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.376885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.377056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.377133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.377287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.377365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.377539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.377618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.377774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.377851 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.378039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.378120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.378271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.378349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.378500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.378578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.378732 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.378812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.378982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.379171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.379249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.379417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.379502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.379675 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.379754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.379911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.379988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.380141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.380227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.380378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] token.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.380456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.380612 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.380690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.380861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.380947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.381099 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.381177 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.381353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.381430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.381586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.381664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.381823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.381919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.382089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.382166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.382333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.382413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.382579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.382656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.382815 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.382893 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.383052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.383131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.383289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.383367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.383536 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.383613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.383785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.383865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] token.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.384014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.384092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.384255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.384333 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.384533 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.384630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.384797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.384874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.connection = **** {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.385037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.385123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.385290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.385368 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.385526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.385609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.385767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.385845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.386024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.386103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.386261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.386341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.386496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.386573 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.386996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.387076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.387239 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.387318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.387471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.387556 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.387712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.387788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.387947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.388026 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.388195 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.388272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.388429 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.388534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.connection = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.388672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.388786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.388901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.389039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.389142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.389282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.389364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.389531 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.389610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:40:21.389799 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.390083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.390326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.390567 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.390816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.391664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.391885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.392265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.392385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.392625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.392873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.393130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.393391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.393641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:40:21.393837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:40:21.508471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.508660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.508832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.509779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.510052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.510281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.518062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.520154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.546305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.546526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.546900 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.547158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.600248 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.601782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.649025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.649255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.650812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.651051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.717482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.717667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.717755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.717897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.717977 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.718079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.718207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.718292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.718385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.718521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.718606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.718738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.742327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.742527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.742618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.742758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.742842 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.742983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.743074 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.743204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.743288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.743420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.743501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.743627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.743717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.743835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.755605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.755955 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.769441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.769587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.769673 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.769823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.769930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.770069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.770166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.770286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.770368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.770493 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.770574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.770702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.770793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.770910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80108) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:40:21.788136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.788349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:40:21.788616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.788731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.788814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:40:21.788890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:40:21.789142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.789227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.789337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:40:21.789432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.789598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.789682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.789850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.790003 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.790125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.790375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.800845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.801137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.801398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.801483 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.801669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.801754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.801958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.802239 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.810509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.810617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.814529 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.814629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.814807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.814892 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.815082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.815167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.815353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.815438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.815625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.815708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.815875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.815960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.816135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.816218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.816397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.816488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.816658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.816742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.816921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.817003 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.817177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.817261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.844539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.844769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.846167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.846421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.846522 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.846701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.851844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.852101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.852215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.852492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.852576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.852774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.859856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.860130 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.860229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.860489 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.864625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.864900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.865012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.865176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.865299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.865451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.865583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.865721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.865867 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.866016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.866167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.866282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.866444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.866526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.866715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.866981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.885714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.886010 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.886540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.887075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.890826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.892389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.895031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.895414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.896203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.896603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.900373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.901708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.903950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.905371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.907709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.907996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.908274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.908559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.908830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.909100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.909182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.909454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.909740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.910048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.910325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.910600 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.928291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.928571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.928834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.929093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.930150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.930440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.930707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.930968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.937009 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.939263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.939535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.939628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.941286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.941583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.944089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.944366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.944643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.944928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.945198 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.946282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.946566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.946855 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.947148 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.947432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.959073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.959346 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.959622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.959905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.960277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.960548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.960819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.962442 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.962735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.963019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.963300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.963699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.963982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.964262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.979092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.982373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.982821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.986377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.986823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.988108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.989756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.990058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.990184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.990333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.991910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.993642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:21.993945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.994250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.997604 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:21.999246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:22.002243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.003181 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.003457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.003845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.003928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:22.004119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.007139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.007431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.007835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.008115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.013557 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:22.013836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.014132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.018097 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:22.018393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.018676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.022212 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80108) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:22.022440 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.022711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.022976 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.023238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.023620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.023891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.024160 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.024436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.024701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.024966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.025225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.025482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.025733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80108) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.026701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:40:22.026980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.027261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.027536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.027809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.028206 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.028486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.028772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.029053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.029325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.029599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.029868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.030156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.030428 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:40:22.064852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564b764ae9c0 pid: 80108 (default app) Jun 16 14:40:22.068235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e219c-04e6-4f05-b82a-18b0bda009b8 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:22.068536 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e219c-04e6-4f05-b82a-18b0bda009b8 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:22.068812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e219c-04e6-4f05-b82a-18b0bda009b8 None None] PATH_INFO: `/v3` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:22.070455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564b764ae9c0 pid: 80109 (default app) Jun 16 14:40:22.072972 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 791 bytes} [Thu Jun 16 14:40:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:29.925764 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17ecfe-883b-4d4c-90ed-f593233f12ad None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:29.926342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17ecfe-883b-4d4c-90ed-f593233f12ad None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:29.926342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17ecfe-883b-4d4c-90ed-f593233f12ad None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:29.930586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1/2] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:29.935730 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1ca73-9af6-4efa-892c-33b9f4c91705 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:29.936110 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1ca73-9af6-4efa-892c-33b9f4c91705 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:29.936275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1ca73-9af6-4efa-892c-33b9f4c91705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:30.005948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: INFO dbcounter [None req-3ab1ca73-9af6-4efa-892c-33b9f4c91705 None None] Registered counter for database keystone Jun 16 14:40:30.027869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG oslo_db.sqlalchemy.engines [None req-3ab1ca73-9af6-4efa-892c-33b9f4c91705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:40:30.034167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writer thread running {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:40:30.211063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG passlib.handlers.bcrypt [None req-3ab1ca73-9af6-4efa-892c-33b9f4c91705 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80108) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 14:40:30.211400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG passlib.handlers.bcrypt [None req-3ab1ca73-9af6-4efa-892c-33b9f4c91705 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80108) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 14:40:30.268921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3ab1ca73-9af6-4efa-892c-33b9f4c91705 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:30.270628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3ab1ca73-9af6-4efa-892c-33b9f4c91705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:30.395609 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 2/3] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 14:40:30.498241 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17ecfe-883b-4d4c-90ed-f593233f12ad None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:30.571695 dv-cinder-837353-2-smb devstack@keystone.service[80109]: INFO dbcounter [None req-2c17ecfe-883b-4d4c-90ed-f593233f12ad None None] Registered counter for database keystone Jun 16 14:40:30.591031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG oslo_db.sqlalchemy.engines [None req-2c17ecfe-883b-4d4c-90ed-f593233f12ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:40:30.598122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writer thread running {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:40:30.747566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17ecfe-883b-4d4c-90ed-f593233f12ad None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:30.752708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f2b03-bc76-4034-a77b-b10a43bbaec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:30.753323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f2b03-bc76-4034-a77b-b10a43bbaec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:30.753608 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f2b03-bc76-4034-a77b-b10a43bbaec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:30.753907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f2b03-bc76-4034-a77b-b10a43bbaec9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:30.762373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f2b03-bc76-4034-a77b-b10a43bbaec9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:30.817345 dv-cinder-837353-2-smb devstack@keystone.service[80109]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b53f2b03-bc76-4034-a77b-b10a43bbaec9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 14:40:30.817682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f2b03-bc76-4034-a77b-b10a43bbaec9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:30.827982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 2/4] 10.222.0.81 () {58 vars in 1324 bytes} [Thu Jun 16 14:40:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 14:40:30.835133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1ca73-9af6-4efa-892c-33b9f4c91705 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:30.852411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1ca73-9af6-4efa-892c-33b9f4c91705 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:30.857453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbf8e9-5509-4d6d-9958-a84dc67fe49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:30.861026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbf8e9-5509-4d6d-9958-a84dc67fe49c admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:30.861026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbf8e9-5509-4d6d-9958-a84dc67fe49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:30.861026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbf8e9-5509-4d6d-9958-a84dc67fe49c admin admin] PATH_INFO: `/v3/projects/d4e16df5d3ec4c65bc803e3fc067e3c7` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:30.861026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbf8e9-5509-4d6d-9958-a84dc67fe49c admin admin] RBAC: Authorizing `identity:get_project(project_id=d4e16df5d3ec4c65bc803e3fc067e3c7)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:30.914150 dv-cinder-837353-2-smb devstack@keystone.service[80108]: WARNING keystone.common.rbac_enforcer.enforcer [None req-95bbf8e9-5509-4d6d-9958-a84dc67fe49c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 14:40:30.914490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbf8e9-5509-4d6d-9958-a84dc67fe49c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:30.919312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 3/5] 10.222.0.81 () {56 vars in 1207 bytes} [Thu Jun 16 14:40:30 2022] GET /identity/v3/projects/d4e16df5d3ec4c65bc803e3fc067e3c7 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:40:33.060785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba13eb-3d71-497d-a5e8-bfe94b69e864 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:33.061287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba13eb-3d71-497d-a5e8-bfe94b69e864 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:33.061287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba13eb-3d71-497d-a5e8-bfe94b69e864 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:33.065736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 3/6] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:33.071235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ece492-c74a-4811-9e2d-b2b1bc824618 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:33.071667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ece492-c74a-4811-9e2d-b2b1bc824618 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:33.071804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ece492-c74a-4811-9e2d-b2b1bc824618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:33.090787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b1ece492-c74a-4811-9e2d-b2b1bc824618 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:33.092348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b1ece492-c74a-4811-9e2d-b2b1bc824618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:33.101455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 4/7] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 14:40:33.124704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba13eb-3d71-497d-a5e8-bfe94b69e864 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:33.137581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba13eb-3d71-497d-a5e8-bfe94b69e864 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:33.142041 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44e906-0ba7-4603-b1ed-485be3937c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:33.142687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44e906-0ba7-4603-b1ed-485be3937c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:33.142973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44e906-0ba7-4603-b1ed-485be3937c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:33.143249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44e906-0ba7-4603-b1ed-485be3937c4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:33.151108 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44e906-0ba7-4603-b1ed-485be3937c4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:33.152910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44e906-0ba7-4603-b1ed-485be3937c4d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:33.162464 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 4/8] 10.222.0.81 () {58 vars in 1324 bytes} [Thu Jun 16 14:40:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 14:40:33.167998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ece492-c74a-4811-9e2d-b2b1bc824618 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:33.177908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ece492-c74a-4811-9e2d-b2b1bc824618 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:33.182390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dea47-f63a-4c7b-9042-85919ae811d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:33.183260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dea47-f63a-4c7b-9042-85919ae811d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:33.183547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dea47-f63a-4c7b-9042-85919ae811d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:33.183826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dea47-f63a-4c7b-9042-85919ae811d8 admin admin] PATH_INFO: `/v3/users/196de148ea764c458b8dc4b5fcb67ec4` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:33.185238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dea47-f63a-4c7b-9042-85919ae811d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=196de148ea764c458b8dc4b5fcb67ec4)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:33.187127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dea47-f63a-4c7b-9042-85919ae811d8 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:33.188735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 5/9] 10.222.0.81 () {56 vars in 1198 bytes} [Thu Jun 16 14:40:33 2022] GET /identity/v3/users/196de148ea764c458b8dc4b5fcb67ec4 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:35.366621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d5ff8-1947-4ce4-8ec1-dcfec0c09ca8 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:35.367139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d5ff8-1947-4ce4-8ec1-dcfec0c09ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:35.367249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d5ff8-1947-4ce4-8ec1-dcfec0c09ca8 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:35.368506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 5/10] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:35.373529 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb1e8d-fed5-4c2d-a20e-d8498e49e3d7 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:35.373923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb1e8d-fed5-4c2d-a20e-d8498e49e3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:35.374232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb1e8d-fed5-4c2d-a20e-d8498e49e3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:35.394886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-09eb1e8d-fed5-4c2d-a20e-d8498e49e3d7 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:35.396105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-09eb1e8d-fed5-4c2d-a20e-d8498e49e3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:35.470356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0f44-e147-4722-88c6-bef78b8b888a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:35.470656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0f44-e147-4722-88c6-bef78b8b888a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:35.470972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0f44-e147-4722-88c6-bef78b8b888a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:35.472352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 6/11] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:40:35.477200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061cdfe-3f29-4f33-93e0-97ab32cbdf1f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:35.477518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061cdfe-3f29-4f33-93e0-97ab32cbdf1f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:35.477994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061cdfe-3f29-4f33-93e0-97ab32cbdf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:35.482588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 6/12] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:40:35.505788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb1e8d-fed5-4c2d-a20e-d8498e49e3d7 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:35.519896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG passlib.handlers.bcrypt [None req-7061cdfe-3f29-4f33-93e0-97ab32cbdf1f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80109) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 14:40:35.520331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG passlib.handlers.bcrypt [None req-7061cdfe-3f29-4f33-93e0-97ab32cbdf1f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80109) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 14:40:35.529819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:35.566392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7061cdfe-3f29-4f33-93e0-97ab32cbdf1f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:35.568008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7061cdfe-3f29-4f33-93e0-97ab32cbdf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:35.611809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb1e8d-fed5-4c2d-a20e-d8498e49e3d7 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:35.647721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1e2b7-09bb-44e8-a3fe-4733f0a39626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:35.648449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1e2b7-09bb-44e8-a3fe-4733f0a39626 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:35.648733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1e2b7-09bb-44e8-a3fe-4733f0a39626 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:35.649013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1e2b7-09bb-44e8-a3fe-4733f0a39626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:35.665230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1e2b7-09bb-44e8-a3fe-4733f0a39626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:35.666554 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 7/13] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-57b1e2b7-09bb-44e8-a3fe-4733f0a39626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:35.677056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:35.678182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:40:35.683523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 7/14] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:40:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:40:35.685313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061cdfe-3f29-4f33-93e0-97ab32cbdf1f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:35.692521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1e2b7-09bb-44e8-a3fe-4733f0a39626 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:35.774520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:35.787960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061cdfe-3f29-4f33-93e0-97ab32cbdf1f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:35.790489 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:35.793020 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1e2b7-09bb-44e8-a3fe-4733f0a39626 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:35.826055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcde7b6-17b5-48f1-99ca-627f2cb9e755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:35.826972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde7b6-17b5-48f1-99ca-627f2cb9e755 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:35.827262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde7b6-17b5-48f1-99ca-627f2cb9e755 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:35.827541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde7b6-17b5-48f1-99ca-627f2cb9e755 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:35.829021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcde7b6-17b5-48f1-99ca-627f2cb9e755 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:35.829348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcde7b6-17b5-48f1-99ca-627f2cb9e755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:35.830171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5695b-a1c2-43b1-a608-f82b8eae1b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:35.830828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5695b-a1c2-43b1-a608-f82b8eae1b23 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:35.830919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcde7b6-17b5-48f1-99ca-627f2cb9e755 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:35.831114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5695b-a1c2-43b1-a608-f82b8eae1b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:35.831393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5695b-a1c2-43b1-a608-f82b8eae1b23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:35.842570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 8/15] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:40:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:35.848209 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcde7b6-17b5-48f1-99ca-627f2cb9e755 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:35.901030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5695b-a1c2-43b1-a608-f82b8eae1b23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:35.902489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5695b-a1c2-43b1-a608-f82b8eae1b23 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:35.946927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcde7b6-17b5-48f1-99ca-627f2cb9e755 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:35.980684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732987eb-ee95-42ce-bf5d-0128fcc221df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:35.981555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732987eb-ee95-42ce-bf5d-0128fcc221df None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:35.981836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732987eb-ee95-42ce-bf5d-0128fcc221df None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:35.982141 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732987eb-ee95-42ce-bf5d-0128fcc221df None admin] PATH_INFO: `/v3/users/196de148ea764c458b8dc4b5fcb67ec4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:35.983701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732987eb-ee95-42ce-bf5d-0128fcc221df None admin] RBAC: Authorizing `identity:get_user(user_id=196de148ea764c458b8dc4b5fcb67ec4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:35.984378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:35.986357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732987eb-ee95-42ce-bf5d-0128fcc221df None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:35.988298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 9/16] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:35 2022] GET /identity/v3/users/196de148ea764c458b8dc4b5fcb67ec4 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:40:35.993557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732987eb-ee95-42ce-bf5d-0128fcc221df None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:36.003736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 8/17] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:40:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:36.009170 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5695b-a1c2-43b1-a608-f82b8eae1b23 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:36.027916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:36.095888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732987eb-ee95-42ce-bf5d-0128fcc221df None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:36.112440 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5695b-a1c2-43b1-a608-f82b8eae1b23 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:36.130069 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c59ca-ca2b-4447-aa17-b1239ec8a44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:36.130871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c59ca-ca2b-4447-aa17-b1239ec8a44b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:36.131156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c59ca-ca2b-4447-aa17-b1239ec8a44b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:36.131435 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c59ca-ca2b-4447-aa17-b1239ec8a44b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:36.132626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c59ca-ca2b-4447-aa17-b1239ec8a44b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:36.134131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c59ca-ca2b-4447-aa17-b1239ec8a44b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:36.135739 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 10/18] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:40:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:40:36.142494 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c59ca-ca2b-4447-aa17-b1239ec8a44b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:36.149173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35d4e5-8ccb-4f22-8f60-7c4e240c965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:36.149981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35d4e5-8ccb-4f22-8f60-7c4e240c965a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:36.150263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35d4e5-8ccb-4f22-8f60-7c4e240c965a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:36.150540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35d4e5-8ccb-4f22-8f60-7c4e240c965a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:36.160520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35d4e5-8ccb-4f22-8f60-7c4e240c965a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:36.161933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35d4e5-8ccb-4f22-8f60-7c4e240c965a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-8d35d4e5-8ccb-4f22-8f60-7c4e240c965a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:40:36.179871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:36.180753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:36.181555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:40:36.181555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:40:36.181555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:40:36.181555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:40:36.181555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 9/19] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:40:36.186701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35d4e5-8ccb-4f22-8f60-7c4e240c965a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:36.222487 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:36.242693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c59ca-ca2b-4447-aa17-b1239ec8a44b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:36.244200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:36.278676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edebfad-1b0f-449c-b235-44710f3dc840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:36.279331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edebfad-1b0f-449c-b235-44710f3dc840 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:36.279614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edebfad-1b0f-449c-b235-44710f3dc840 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:36.279887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edebfad-1b0f-449c-b235-44710f3dc840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:36.280715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edebfad-1b0f-449c-b235-44710f3dc840 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.domain.id=default, user.id=196de148ea764c458b8dc4b5fcb67ec4) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:36.281024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edebfad-1b0f-449c-b235-44710f3dc840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:36.283405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edebfad-1b0f-449c-b235-44710f3dc840 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:36.291985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35d4e5-8ccb-4f22-8f60-7c4e240c965a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:36.292126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 11/20] 10.222.0.81 () {56 vars in 1322 bytes} [Thu Jun 16 14:40:36 2022] GET /identity/v3/role_assignments?user.id=196de148ea764c458b8dc4b5fcb67ec4&scope.domain.id=default&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:40:36.328895 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff59450-4164-469a-bca3-370fb4a4eda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:36.329588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59450-4164-469a-bca3-370fb4a4eda6 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:36.329869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59450-4164-469a-bca3-370fb4a4eda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:36.330173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59450-4164-469a-bca3-370fb4a4eda6 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:36.330930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff59450-4164-469a-bca3-370fb4a4eda6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:36.331240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff59450-4164-469a-bca3-370fb4a4eda6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:36.332707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff59450-4164-469a-bca3-370fb4a4eda6 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:36.353583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 10/21] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:40:38.795136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54656af-8222-4684-a77b-4f92b80cef66 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:38.796269 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54656af-8222-4684-a77b-4f92b80cef66 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:38.796756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54656af-8222-4684-a77b-4f92b80cef66 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:38.798408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 12/22] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:38.804130 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed48d3-c188-4104-86c2-d24592f3db7a None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:38.804981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed48d3-c188-4104-86c2-d24592f3db7a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:38.805475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed48d3-c188-4104-86c2-d24592f3db7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:38.830909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-feed48d3-c188-4104-86c2-d24592f3db7a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:38.832443 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-feed48d3-c188-4104-86c2-d24592f3db7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:38.927261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 11/23] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:38.965443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54656af-8222-4684-a77b-4f92b80cef66 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:38.976388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051902f-6f1d-4ce0-9de4-bd941e58b15d None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:38.978979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051902f-6f1d-4ce0-9de4-bd941e58b15d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:38.979534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051902f-6f1d-4ce0-9de4-bd941e58b15d None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:38.984450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 12/24] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:38.989414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82bf35-54b2-46f4-b0ac-c5cdd786fd3c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:38.990302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82bf35-54b2-46f4-b0ac-c5cdd786fd3c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:38.991896 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82bf35-54b2-46f4-b0ac-c5cdd786fd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:39.023450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-fe82bf35-54b2-46f4-b0ac-c5cdd786fd3c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:39.026804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-fe82bf35-54b2-46f4-b0ac-c5cdd786fd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:39.066077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:39.180388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54656af-8222-4684-a77b-4f92b80cef66 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:39.194452 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 13/25] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:39.197814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2088-bcb7-4b8f-82d6-0866d386604c None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:39.198334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2088-bcb7-4b8f-82d6-0866d386604c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:39.198820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2088-bcb7-4b8f-82d6-0866d386604c None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:39.200263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 14/26] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:39.217467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa09b5-faee-4869-933b-f795911282bc None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:39.218044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa09b5-faee-4869-933b-f795911282bc None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:39.218533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa09b5-faee-4869-933b-f795911282bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:39.251896 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a9fa09b5-faee-4869-933b-f795911282bc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:39.253757 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a9fa09b5-faee-4869-933b-f795911282bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:39.271441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1989a1-85fb-49c3-a524-33867ae97fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:39.272468 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1989a1-85fb-49c3-a524-33867ae97fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:39.272892 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1989a1-85fb-49c3-a524-33867ae97fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:39.273302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1989a1-85fb-49c3-a524-33867ae97fb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:39.293506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1989a1-85fb-49c3-a524-33867ae97fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ee1989a1-85fb-49c3-a524-33867ae97fb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:39.306399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:39.307451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:40:39.308373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:40:39.310321 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 13/27] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:40:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:39.311294 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1989a1-85fb-49c3-a524-33867ae97fb2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:39.355829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:39.434092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 15/28] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:40:39.435235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa09b5-faee-4869-933b-f795911282bc None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:39.498302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1989a1-85fb-49c3-a524-33867ae97fb2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:39.567725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb40b6-84e2-430f-a306-e875f3cb52ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:39.569401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb40b6-84e2-430f-a306-e875f3cb52ce None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:39.570493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb40b6-84e2-430f-a306-e875f3cb52ce None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:39.571073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb40b6-84e2-430f-a306-e875f3cb52ce None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:39.572903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb40b6-84e2-430f-a306-e875f3cb52ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:39.574633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb40b6-84e2-430f-a306-e875f3cb52ce None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:39.622067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:39.647982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa09b5-faee-4869-933b-f795911282bc None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:39.725518 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf62b-325d-4ca9-a082-e057cf06e158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:39.726133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf62b-325d-4ca9-a082-e057cf06e158 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:39.726415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf62b-325d-4ca9-a082-e057cf06e158 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:39.726693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf62b-325d-4ca9-a082-e057cf06e158 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:39.727441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baf62b-325d-4ca9-a082-e057cf06e158 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:39.727746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baf62b-325d-4ca9-a082-e057cf06e158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:39.729129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baf62b-325d-4ca9-a082-e057cf06e158 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:39.746569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 16/29] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:40:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:39.747569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf62b-325d-4ca9-a082-e057cf06e158 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:39.782209 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 14/30] 10.222.0.81 () {60 vars in 1131 bytes} [Thu Jun 16 14:40:39 2022] POST /identity/v3/roles => generated 219 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:40:39.783649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0a07-8a27-4c93-8770-4f52ee83da8f None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:39.783945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0a07-8a27-4c93-8770-4f52ee83da8f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:39.784290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0a07-8a27-4c93-8770-4f52ee83da8f None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:39.786843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 15/31] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:39.787473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c0a07-8a27-4c93-8770-4f52ee83da8f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:39.922822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf62b-325d-4ca9-a082-e057cf06e158 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:39.943240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:39.976798 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d7d57-e567-41aa-8d3a-402e55b41c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:39.977583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7d57-e567-41aa-8d3a-402e55b41c89 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:39.978094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7d57-e567-41aa-8d3a-402e55b41c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:39.979087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7d57-e567-41aa-8d3a-402e55b41c89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:39.982928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c0a07-8a27-4c93-8770-4f52ee83da8f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:39.994893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d7d57-e567-41aa-8d3a-402e55b41c89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:39.997463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d7d57-e567-41aa-8d3a-402e55b41c89 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:40.007140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-f03d7d57-e567-41aa-8d3a-402e55b41c89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:40:40.024579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:40.025593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:40.026618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:40:40.026618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:40:40.026618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:40:40.026618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:40:40.026860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa9f7b-7327-4ccd-9ddc-13c507fef94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:40.027756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa9f7b-7327-4ccd-9ddc-13c507fef94f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:40.028135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa9f7b-7327-4ccd-9ddc-13c507fef94f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:40.028514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa9f7b-7327-4ccd-9ddc-13c507fef94f None admin] PATH_INFO: `/v3/users/196de148ea764c458b8dc4b5fcb67ec4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:40.028879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 17/32] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:40.030355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa9f7b-7327-4ccd-9ddc-13c507fef94f None admin] RBAC: Authorizing `identity:get_user(user_id=196de148ea764c458b8dc4b5fcb67ec4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:40.030580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7980b-f311-4703-b53c-ba4244b7d0bb None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:40.030997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7980b-f311-4703-b53c-ba4244b7d0bb None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:40.031497 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7980b-f311-4703-b53c-ba4244b7d0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:40.032462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa9f7b-7327-4ccd-9ddc-13c507fef94f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:40.034974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 16/33] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:39 2022] GET /identity/v3/users/196de148ea764c458b8dc4b5fcb67ec4 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:40.035841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa9f7b-7327-4ccd-9ddc-13c507fef94f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:40.057591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a3d7980b-f311-4703-b53c-ba4244b7d0bb None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:40.059038 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a3d7980b-f311-4703-b53c-ba4244b7d0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:40.148325 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 18/34] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:40.149462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7980b-f311-4703-b53c-ba4244b7d0bb None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:40.172869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa9f7b-7327-4ccd-9ddc-13c507fef94f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:40.217043 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a0d26-3726-4c5d-b640-15ea58a20048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:40.217043 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a0d26-3726-4c5d-b640-15ea58a20048 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:40.217043 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a0d26-3726-4c5d-b640-15ea58a20048 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:40.217043 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a0d26-3726-4c5d-b640-15ea58a20048 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:40.217436 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a0d26-3726-4c5d-b640-15ea58a20048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:40.217501 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a0d26-3726-4c5d-b640-15ea58a20048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:40.220011 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a0d26-3726-4c5d-b640-15ea58a20048 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:40.243496 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 17/35] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:40.244737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677b49e-5284-4f76-9156-dda953a48400 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:40.245028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677b49e-5284-4f76-9156-dda953a48400 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:40.245305 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677b49e-5284-4f76-9156-dda953a48400 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:40.252502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 18/36] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:40.252502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677b49e-5284-4f76-9156-dda953a48400 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:40.268058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:40.276720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7980b-f311-4703-b53c-ba4244b7d0bb None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:40.305465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:40.316990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd2d33-0e6c-439b-be1d-1f710af4d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:40.318500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2d33-0e6c-439b-be1d-1f710af4d005 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:40.319177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2d33-0e6c-439b-be1d-1f710af4d005 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:40.319602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2d33-0e6c-439b-be1d-1f710af4d005 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:40.322039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd2d33-0e6c-439b-be1d-1f710af4d005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:40.324303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd2d33-0e6c-439b-be1d-1f710af4d005 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:40.326394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 19/37] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:40:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:40.327527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd2d33-0e6c-439b-be1d-1f710af4d005 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:40.365265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677b49e-5284-4f76-9156-dda953a48400 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:40.402193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fcf20-6457-4c16-9758-7e0d8348b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:40.403016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fcf20-6457-4c16-9758-7e0d8348b7a3 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:40.403376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fcf20-6457-4c16-9758-7e0d8348b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:40.403633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fcf20-6457-4c16-9758-7e0d8348b7a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:40.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fcf20-6457-4c16-9758-7e0d8348b7a3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:40.406012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fcf20-6457-4c16-9758-7e0d8348b7a3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:40.429915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 19/38] 10.222.0.81 () {60 vars in 1131 bytes} [Thu Jun 16 14:40:40 2022] POST /identity/v3/roles => generated 225 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:40:40.429915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900933e-bb17-4d0b-90f7-aa3b132cbefc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:40.429915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900933e-bb17-4d0b-90f7-aa3b132cbefc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:40.429915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900933e-bb17-4d0b-90f7-aa3b132cbefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:40.449119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1900933e-bb17-4d0b-90f7-aa3b132cbefc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:40.450823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1900933e-bb17-4d0b-90f7-aa3b132cbefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:40.460503 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd2d33-0e6c-439b-be1d-1f710af4d005 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:40.509381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb09fc-373b-4910-b5bc-3c57bf5dc108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:40.510183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb09fc-373b-4910-b5bc-3c57bf5dc108 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:40.510563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb09fc-373b-4910-b5bc-3c57bf5dc108 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:40.510936 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb09fc-373b-4910-b5bc-3c57bf5dc108 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:40.511821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb09fc-373b-4910-b5bc-3c57bf5dc108 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:40.513831 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb09fc-373b-4910-b5bc-3c57bf5dc108 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:40.555378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 20/39] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:40.556336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900933e-bb17-4d0b-90f7-aa3b132cbefc None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:40.560930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:40.782280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900933e-bb17-4d0b-90f7-aa3b132cbefc None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:40.790933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 20/40] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:40:40 2022] POST /identity/v3/projects => generated 301 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:40:40.792474 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd2c54-d731-42ac-92c3-b7bda8d91d63 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:40.792767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd2c54-d731-42ac-92c3-b7bda8d91d63 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:40.793055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd2c54-d731-42ac-92c3-b7bda8d91d63 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:40.794359 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 21/41] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:40.795082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd2c54-d731-42ac-92c3-b7bda8d91d63 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:40.823007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a26350-e12f-49de-a871-4fb1970ba92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:40.823917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a26350-e12f-49de-a871-4fb1970ba92e None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:40.824198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a26350-e12f-49de-a871-4fb1970ba92e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:40.824477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a26350-e12f-49de-a871-4fb1970ba92e None admin] PATH_INFO: `/v3/domains/default/users/196de148ea764c458b8dc4b5fcb67ec4/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:40.826791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a26350-e12f-49de-a871-4fb1970ba92e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=196de148ea764c458b8dc4b5fcb67ec4, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:40.828830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a26350-e12f-49de-a871-4fb1970ba92e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:40.846702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 21/42] 10.222.0.81 () {58 vars in 1361 bytes} [Thu Jun 16 14:40:40 2022] PUT /identity/v3/domains/default/users/196de148ea764c458b8dc4b5fcb67ec4/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:40:40.847849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48813c-c201-4b78-be60-3484e3a9d8f8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:40.848174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48813c-c201-4b78-be60-3484e3a9d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:40.848547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48813c-c201-4b78-be60-3484e3a9d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:40.869835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:40.870077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ad48813c-c201-4b78-be60-3484e3a9d8f8 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:40.871362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ad48813c-c201-4b78-be60-3484e3a9d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:40.952132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd2c54-d731-42ac-92c3-b7bda8d91d63 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:40.969223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:40.983449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 22/43] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:41.006731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60cbb1-73b4-4e09-8908-388bcdd1ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:41.007672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60cbb1-73b4-4e09-8908-388bcdd1ec7b None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:41.008117 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60cbb1-73b4-4e09-8908-388bcdd1ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:41.008534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60cbb1-73b4-4e09-8908-388bcdd1ec7b None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:41.009505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60cbb1-73b4-4e09-8908-388bcdd1ec7b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:41.010240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48813c-c201-4b78-be60-3484e3a9d8f8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:41.011345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60cbb1-73b4-4e09-8908-388bcdd1ec7b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:41.030128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 22/44] 10.222.0.81 () {60 vars in 1131 bytes} [Thu Jun 16 14:40:40 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:40:41.154921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48813c-c201-4b78-be60-3484e3a9d8f8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:41.213672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a368b7-c736-4437-b239-df2696442d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:41.215016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a368b7-c736-4437-b239-df2696442d01 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:41.215473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a368b7-c736-4437-b239-df2696442d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:41.215936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a368b7-c736-4437-b239-df2696442d01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:41.217788 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a368b7-c736-4437-b239-df2696442d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:41.220787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a368b7-c736-4437-b239-df2696442d01 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:41.227781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 23/45] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:40:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:40:41.228950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60cbb1-73b4-4e09-8908-388bcdd1ec7b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:41.342242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60cbb1-73b4-4e09-8908-388bcdd1ec7b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:41.352192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:41.379584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1575a0-bcef-41b4-9499-bc23dbfcf143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:41.380174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1575a0-bcef-41b4-9499-bc23dbfcf143 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:41.380422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1575a0-bcef-41b4-9499-bc23dbfcf143 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:41.380698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1575a0-bcef-41b4-9499-bc23dbfcf143 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:41.381410 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1575a0-bcef-41b4-9499-bc23dbfcf143 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:41.382908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1575a0-bcef-41b4-9499-bc23dbfcf143 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:41.410723 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 23/46] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:40:41 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:40:43.074729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d2bee-4966-4191-a9f8-a704b32c6c95 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:43.075210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d2bee-4966-4191-a9f8-a704b32c6c95 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:43.075210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d2bee-4966-4191-a9f8-a704b32c6c95 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:43.076590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 24/47] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:43.086771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b725a9e-eb83-4acc-a536-7a1653ac2c74 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:43.088018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b725a9e-eb83-4acc-a536-7a1653ac2c74 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:43.088462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b725a9e-eb83-4acc-a536-7a1653ac2c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:43.105572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-1b725a9e-eb83-4acc-a536-7a1653ac2c74 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:43.107127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1b725a9e-eb83-4acc-a536-7a1653ac2c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:43.174292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 24/48] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:43.197134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d2bee-4966-4191-a9f8-a704b32c6c95 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:43.261132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:43.301115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d2bee-4966-4191-a9f8-a704b32c6c95 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:43.333871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09873091-1bdc-475d-a263-a5e22ef6e5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:43.334705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09873091-1bdc-475d-a263-a5e22ef6e5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:43.334990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09873091-1bdc-475d-a263-a5e22ef6e5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:43.335269 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09873091-1bdc-475d-a263-a5e22ef6e5e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:43.345217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09873091-1bdc-475d-a263-a5e22ef6e5e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-09873091-1bdc-475d-a263-a5e22ef6e5e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:43.352816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:43.353705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:40:43.354513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 25/49] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:43.360125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b725a9e-eb83-4acc-a536-7a1653ac2c74 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:43.454710 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:43.465365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b725a9e-eb83-4acc-a536-7a1653ac2c74 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:43.503456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016aa3-d5dc-415b-b03a-55929677244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:43.504153 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016aa3-d5dc-415b-b03a-55929677244e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:43.504441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016aa3-d5dc-415b-b03a-55929677244e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:43.504721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016aa3-d5dc-415b-b03a-55929677244e None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:43.505485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016aa3-d5dc-415b-b03a-55929677244e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:43.505797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016aa3-d5dc-415b-b03a-55929677244e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:43.507296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016aa3-d5dc-415b-b03a-55929677244e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:43.516736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 25/50] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:43.522330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09873091-1bdc-475d-a263-a5e22ef6e5e5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:43.549505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59717b-2c3d-46d9-80ef-1cf55ff962f0 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:43.549818 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59717b-2c3d-46d9-80ef-1cf55ff962f0 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:43.550132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59717b-2c3d-46d9-80ef-1cf55ff962f0 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:43.551496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 26/51] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:43.557263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f517dad-fde3-48b4-98db-b799e806750e None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:43.557560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f517dad-fde3-48b4-98db-b799e806750e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:43.557842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f517dad-fde3-48b4-98db-b799e806750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:43.576792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6f517dad-fde3-48b4-98db-b799e806750e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:43.578045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6f517dad-fde3-48b4-98db-b799e806750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:43.624596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09873091-1bdc-475d-a263-a5e22ef6e5e5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:43.648268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:43.649244 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 27/52] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:40:43.662776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e76e5-b41f-4950-a77c-6e2bc080692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:43.663689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e76e5-b41f-4950-a77c-6e2bc080692b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:43.663954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e76e5-b41f-4950-a77c-6e2bc080692b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:43.664232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e76e5-b41f-4950-a77c-6e2bc080692b None admin] PATH_INFO: `/v3/users/196de148ea764c458b8dc4b5fcb67ec4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:43.665441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e76e5-b41f-4950-a77c-6e2bc080692b None admin] RBAC: Authorizing `identity:get_user(user_id=196de148ea764c458b8dc4b5fcb67ec4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:43.666926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e76e5-b41f-4950-a77c-6e2bc080692b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:43.668721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 26/53] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:43 2022] GET /identity/v3/users/196de148ea764c458b8dc4b5fcb67ec4 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:43.672673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f517dad-fde3-48b4-98db-b799e806750e None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:43.674282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e76e5-b41f-4950-a77c-6e2bc080692b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:43.755673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:43.775422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e76e5-b41f-4950-a77c-6e2bc080692b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:43.775603 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f517dad-fde3-48b4-98db-b799e806750e None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:43.810298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961088f-86e7-486e-8afa-f8d6af7b2878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:43.810993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df838e65-1206-4ca8-8efb-f07608ceb856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:43.811140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961088f-86e7-486e-8afa-f8d6af7b2878 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:43.811377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961088f-86e7-486e-8afa-f8d6af7b2878 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:43.811657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961088f-86e7-486e-8afa-f8d6af7b2878 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:43.811791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df838e65-1206-4ca8-8efb-f07608ceb856 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:43.812074 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df838e65-1206-4ca8-8efb-f07608ceb856 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:43.812348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df838e65-1206-4ca8-8efb-f07608ceb856 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:43.813448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961088f-86e7-486e-8afa-f8d6af7b2878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:43.814149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df838e65-1206-4ca8-8efb-f07608ceb856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:43.814946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961088f-86e7-486e-8afa-f8d6af7b2878 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:43.815582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df838e65-1206-4ca8-8efb-f07608ceb856 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:43.816582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 27/54] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:40:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:40:43.820663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 28/55] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:40:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:43.822281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961088f-86e7-486e-8afa-f8d6af7b2878 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:43.822714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df838e65-1206-4ca8-8efb-f07608ceb856 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:43.880846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:43.922658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df838e65-1206-4ca8-8efb-f07608ceb856 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:43.923035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961088f-86e7-486e-8afa-f8d6af7b2878 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:43.956912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c65dec-0f9c-4302-902a-944e251d8e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:43.957099 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb831150-0c2a-4c10-ac67-903088dd3408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:43.957583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c65dec-0f9c-4302-902a-944e251d8e97 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:43.957737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb831150-0c2a-4c10-ac67-903088dd3408 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:43.957895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c65dec-0f9c-4302-902a-944e251d8e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:43.958056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb831150-0c2a-4c10-ac67-903088dd3408 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:43.958178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c65dec-0f9c-4302-902a-944e251d8e97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:43.958338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb831150-0c2a-4c10-ac67-903088dd3408 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:43.959014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c65dec-0f9c-4302-902a-944e251d8e97 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.domain.id=default, user.id=196de148ea764c458b8dc4b5fcb67ec4) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:43.959110 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb831150-0c2a-4c10-ac67-903088dd3408 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:43.959330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c65dec-0f9c-4302-902a-944e251d8e97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:43.960487 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb831150-0c2a-4c10-ac67-903088dd3408 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:43.960745 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c65dec-0f9c-4302-902a-944e251d8e97 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:43.966619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 28/56] 10.222.0.81 () {56 vars in 1322 bytes} [Thu Jun 16 14:40:43 2022] GET /identity/v3/role_assignments?user.id=196de148ea764c458b8dc4b5fcb67ec4&scope.domain.id=default&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:43.986409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 29/57] 10.222.0.81 () {60 vars in 1140 bytes} [Thu Jun 16 14:40:43 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:40:46.116668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd549d51-6038-4e6e-80a6-5fc8b68b0d80 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:46.117160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd549d51-6038-4e6e-80a6-5fc8b68b0d80 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:46.117270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd549d51-6038-4e6e-80a6-5fc8b68b0d80 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:46.118629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 29/58] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:46.123767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4d4bc-6292-49d9-a71e-03bb97805840 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:46.124180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4d4bc-6292-49d9-a71e-03bb97805840 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:46.124324 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4d4bc-6292-49d9-a71e-03bb97805840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:46.129496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:46.143841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-51d4d4bc-6292-49d9-a71e-03bb97805840 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:46.145021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-51d4d4bc-6292-49d9-a71e-03bb97805840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:46.209487 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 30/59] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:46.233462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd549d51-6038-4e6e-80a6-5fc8b68b0d80 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:46.351681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd549d51-6038-4e6e-80a6-5fc8b68b0d80 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:46.373643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:46.385732 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc872c3-50c1-42df-8202-e8acd3c057fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:46.386558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc872c3-50c1-42df-8202-e8acd3c057fb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:46.386841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc872c3-50c1-42df-8202-e8acd3c057fb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:46.387377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc872c3-50c1-42df-8202-e8acd3c057fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:46.388543 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc872c3-50c1-42df-8202-e8acd3c057fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:46.390006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc872c3-50c1-42df-8202-e8acd3c057fb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:46.392300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 30/60] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:40:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:46.397937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4d4bc-6292-49d9-a71e-03bb97805840 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:46.494849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4d4bc-6292-49d9-a71e-03bb97805840 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:46.524291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:46.529551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21f052-0805-4c21-b7a0-967053fdec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:46.530255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f052-0805-4c21-b7a0-967053fdec68 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:46.530545 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f052-0805-4c21-b7a0-967053fdec68 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:46.530826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f052-0805-4c21-b7a0-967053fdec68 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:46.531563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21f052-0805-4c21-b7a0-967053fdec68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:46.533036 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21f052-0805-4c21-b7a0-967053fdec68 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:46.558915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 31/61] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:40:46 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:40:49.772141 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c05f5-480f-4495-a05a-331568b90fa3 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:49.772972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c05f5-480f-4495-a05a-331568b90fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:49.773389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c05f5-480f-4495-a05a-331568b90fa3 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:49.774933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 31/62] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:49.787622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8f2bc-bfb9-43ef-b2ed-15d0fc4e4bf1 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:49.788080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8f2bc-bfb9-43ef-b2ed-15d0fc4e4bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:49.788185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8f2bc-bfb9-43ef-b2ed-15d0fc4e4bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:49.814903 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-cfb8f2bc-bfb9-43ef-b2ed-15d0fc4e4bf1 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:49.816341 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-cfb8f2bc-bfb9-43ef-b2ed-15d0fc4e4bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:49.891157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 32/63] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:49.927419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c05f5-480f-4495-a05a-331568b90fa3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:50.075729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c05f5-480f-4495-a05a-331568b90fa3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:50.094666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485788b-bdde-4685-99d1-e81713b0ee01 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.095309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485788b-bdde-4685-99d1-e81713b0ee01 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.095775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485788b-bdde-4685-99d1-e81713b0ee01 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.097334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 33/64] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:40:50.103848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d2aed-162d-4531-a368-1fcf961adcdd None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.104371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d2aed-162d-4531-a368-1fcf961adcdd None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.104796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d2aed-162d-4531-a368-1fcf961adcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.131882 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-185d2aed-162d-4531-a368-1fcf961adcdd None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:50.134245 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-185d2aed-162d-4531-a368-1fcf961adcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:50.147000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b6cb9-8ae6-45ab-b5be-3c3ee432fdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:50.148029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b6cb9-8ae6-45ab-b5be-3c3ee432fdca None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.148458 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b6cb9-8ae6-45ab-b5be-3c3ee432fdca None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.148902 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b6cb9-8ae6-45ab-b5be-3c3ee432fdca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.170330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b6cb9-8ae6-45ab-b5be-3c3ee432fdca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b21b6cb9-8ae6-45ab-b5be-3c3ee432fdca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:50.188014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:50.189402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:40:50.190388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:40:50.195169 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 32/65] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:40:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:50.202287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b6cb9-8ae6-45ab-b5be-3c3ee432fdca None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:50.247828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 34/66] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:40:50.269515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604748f-6ad3-42fe-9e68-35ccbd971b84 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.269831 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604748f-6ad3-42fe-9e68-35ccbd971b84 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.270101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604748f-6ad3-42fe-9e68-35ccbd971b84 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.272329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 35/67] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:40:50.278016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7333f-a4c9-4064-8cfb-e9be277dbc78 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.278311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7333f-a4c9-4064-8cfb-e9be277dbc78 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.278593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7333f-a4c9-4064-8cfb-e9be277dbc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.289281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:50.304752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-73b7333f-a4c9-4064-8cfb-e9be277dbc78 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:50.306524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-73b7333f-a4c9-4064-8cfb-e9be277dbc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:50.351111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b6cb9-8ae6-45ab-b5be-3c3ee432fdca None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:50.370088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:50.394091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21345c7f-2b64-4dab-9988-b8c5df72aa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:50.395124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21345c7f-2b64-4dab-9988-b8c5df72aa0d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.395599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21345c7f-2b64-4dab-9988-b8c5df72aa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.396104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21345c7f-2b64-4dab-9988-b8c5df72aa0d None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.396955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21345c7f-2b64-4dab-9988-b8c5df72aa0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:50.397352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21345c7f-2b64-4dab-9988-b8c5df72aa0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:50.398811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 36/68] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:40:50.399017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21345c7f-2b64-4dab-9988-b8c5df72aa0d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:50.399935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7333f-a4c9-4064-8cfb-e9be277dbc78 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:50.410099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 33/69] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:40:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:50.418890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21345c7f-2b64-4dab-9988-b8c5df72aa0d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:50.516269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7333f-a4c9-4064-8cfb-e9be277dbc78 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:50.532517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21345c7f-2b64-4dab-9988-b8c5df72aa0d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:50.546275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:50.552072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75733d-6d39-45bb-90cd-e2ca1cb02aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:50.552876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75733d-6d39-45bb-90cd-e2ca1cb02aee None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.553161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75733d-6d39-45bb-90cd-e2ca1cb02aee None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.553438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75733d-6d39-45bb-90cd-e2ca1cb02aee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.564354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75733d-6d39-45bb-90cd-e2ca1cb02aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:50.568585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b28a2-80d5-4913-8e67-ebcadc8b99ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:50.569463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b28a2-80d5-4913-8e67-ebcadc8b99ff None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.569749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b28a2-80d5-4913-8e67-ebcadc8b99ff None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.570059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b28a2-80d5-4913-8e67-ebcadc8b99ff None admin] PATH_INFO: `/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-aa75733d-6d39-45bb-90cd-e2ca1cb02aee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:50.571996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:50.573003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:40:50.573782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 37/70] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:40:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:50.574882 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28c3a0-26a3-4aa2-bdf0-06d3ec6eb1e7 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.574882 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28c3a0-26a3-4aa2-bdf0-06d3ec6eb1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.575126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28c3a0-26a3-4aa2-bdf0-06d3ec6eb1e7 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.576528 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 38/71] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:50.581321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28c3a0-26a3-4aa2-bdf0-06d3ec6eb1e7 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:50.587085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b28a2-80d5-4913-8e67-ebcadc8b99ff None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d1ccb3a22469bbe646d3ebef6e225)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:50.588549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b28a2-80d5-4913-8e67-ebcadc8b99ff None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:50.590275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 34/72] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:50 2022] GET /identity/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:50.591493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb0f3-3fdd-48ac-843c-8e8a5e7b92b9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.591779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb0f3-3fdd-48ac-843c-8e8a5e7b92b9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.592054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb0f3-3fdd-48ac-843c-8e8a5e7b92b9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.593416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 35/73] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:50.595268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecb0f3-3fdd-48ac-843c-8e8a5e7b92b9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:50.632323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:50.696981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28c3a0-26a3-4aa2-bdf0-06d3ec6eb1e7 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:50.702773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecb0f3-3fdd-48ac-843c-8e8a5e7b92b9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:50.732678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbfe01-c4f5-465c-bbc2-7622d4900f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:50.733493 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbfe01-c4f5-465c-bbc2-7622d4900f76 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.733780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbfe01-c4f5-465c-bbc2-7622d4900f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.734088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbfe01-c4f5-465c-bbc2-7622d4900f76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.737484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56b4d9-a638-4dea-bfac-ca2437d8fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:50.738180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56b4d9-a638-4dea-bfac-ca2437d8fed6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.738462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56b4d9-a638-4dea-bfac-ca2437d8fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.738737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56b4d9-a638-4dea-bfac-ca2437d8fed6 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.739480 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56b4d9-a638-4dea-bfac-ca2437d8fed6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:50.739810 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56b4d9-a638-4dea-bfac-ca2437d8fed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:50.741152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56b4d9-a638-4dea-bfac-ca2437d8fed6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:50.745122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbfe01-c4f5-465c-bbc2-7622d4900f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:50.749110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 36/74] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:50.750390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0c00-3e88-4351-8fba-e26ba557f44b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.750680 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0c00-3e88-4351-8fba-e26ba557f44b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.751132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0c00-3e88-4351-8fba-e26ba557f44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-42bbfe01-c4f5-465c-bbc2-7622d4900f76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:50.754954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:50.755784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:40:50.756558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 39/75] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:40:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:50.757173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbfe01-c4f5-465c-bbc2-7622d4900f76 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:50.770456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-0dbf0c00-3e88-4351-8fba-e26ba557f44b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:50.771634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0dbf0c00-3e88-4351-8fba-e26ba557f44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:50.797897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:50.838705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 37/76] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:50.839979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f0865-1edc-4e27-8e8c-9b343fd4a3b3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.840279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f0865-1edc-4e27-8e8c-9b343fd4a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.840562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f0865-1edc-4e27-8e8c-9b343fd4a3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.857559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-913f0865-1edc-4e27-8e8c-9b343fd4a3b3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:50.858782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-913f0865-1edc-4e27-8e8c-9b343fd4a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:50.863429 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:50.867705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbfe01-c4f5-465c-bbc2-7622d4900f76 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:50.901753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1767fc-934e-4cf0-ba29-6debe7704774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:50.902436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1767fc-934e-4cf0-ba29-6debe7704774 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:50.902720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1767fc-934e-4cf0-ba29-6debe7704774 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:50.902995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1767fc-934e-4cf0-ba29-6debe7704774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:50.925756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 38/77] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:50.926625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f0865-1edc-4e27-8e8c-9b343fd4a3b3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:50.979074 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1767fc-934e-4cf0-ba29-6debe7704774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:50.980601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1767fc-934e-4cf0-ba29-6debe7704774 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:51.025818 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:51.035013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f0865-1edc-4e27-8e8c-9b343fd4a3b3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:51.068222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb2c7a-8028-445d-9fc2-7e2f79a52190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:51.069094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb2c7a-8028-445d-9fc2-7e2f79a52190 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:51.069373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb2c7a-8028-445d-9fc2-7e2f79a52190 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:51.069644 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb2c7a-8028-445d-9fc2-7e2f79a52190 None admin] PATH_INFO: `/v3/users/196de148ea764c458b8dc4b5fcb67ec4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:51.070875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb2c7a-8028-445d-9fc2-7e2f79a52190 None admin] RBAC: Authorizing `identity:get_user(user_id=196de148ea764c458b8dc4b5fcb67ec4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:51.072326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb2c7a-8028-445d-9fc2-7e2f79a52190 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:51.073956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 39/78] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:50 2022] GET /identity/v3/users/196de148ea764c458b8dc4b5fcb67ec4 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:51.074711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb2c7a-8028-445d-9fc2-7e2f79a52190 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:51.079063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:51.087211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 40/79] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:40:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:51.088031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1767fc-934e-4cf0-ba29-6debe7704774 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:51.179863 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb2c7a-8028-445d-9fc2-7e2f79a52190 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:51.189330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1767fc-934e-4cf0-ba29-6debe7704774 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:51.214392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c035a-1723-49d8-8482-e34184eb8c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:51.215062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c035a-1723-49d8-8482-e34184eb8c23 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:51.215346 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c035a-1723-49d8-8482-e34184eb8c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:51.215622 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c035a-1723-49d8-8482-e34184eb8c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:51.216953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c035a-1723-49d8-8482-e34184eb8c23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:51.216953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c035a-1723-49d8-8482-e34184eb8c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:51.218083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c035a-1723-49d8-8482-e34184eb8c23 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:51.224255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cd42a-0ee0-4977-859a-9cd9bb47737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:51.225059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cd42a-0ee0-4977-859a-9cd9bb47737f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:51.225345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cd42a-0ee0-4977-859a-9cd9bb47737f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:51.225625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cd42a-0ee0-4977-859a-9cd9bb47737f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:51.227042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 40/80] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:40:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:51.227835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c035a-1723-49d8-8482-e34184eb8c23 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:51.237367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cd42a-0ee0-4977-859a-9cd9bb47737f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-c04cd42a-0ee0-4977-859a-9cd9bb47737f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:51.246333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:51.247199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:40:51.248157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 41/81] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:40:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:51.249372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cd42a-0ee0-4977-859a-9cd9bb47737f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:51.259450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:51.307590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:51.337830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c035a-1723-49d8-8482-e34184eb8c23 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:51.350704 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cd42a-0ee0-4977-859a-9cd9bb47737f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:51.371254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71105bb-3f2b-4ee7-8ed9-cf8e437d0534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:51.372052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71105bb-3f2b-4ee7-8ed9-cf8e437d0534 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:51.372337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71105bb-3f2b-4ee7-8ed9-cf8e437d0534 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:51.372614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71105bb-3f2b-4ee7-8ed9-cf8e437d0534 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:51.373809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71105bb-3f2b-4ee7-8ed9-cf8e437d0534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:51.375941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71105bb-3f2b-4ee7-8ed9-cf8e437d0534 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:51.377558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 41/82] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:40:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:51.378350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71105bb-3f2b-4ee7-8ed9-cf8e437d0534 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:51.384901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73c56a-b9e4-4fbc-9e4e-db69e8a8f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:51.385556 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73c56a-b9e4-4fbc-9e4e-db69e8a8f6bd None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:51.385840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73c56a-b9e4-4fbc-9e4e-db69e8a8f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:51.386144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73c56a-b9e4-4fbc-9e4e-db69e8a8f6bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:51.453843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73c56a-b9e4-4fbc-9e4e-db69e8a8f6bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:51.455357 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73c56a-b9e4-4fbc-9e4e-db69e8a8f6bd None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:51.469849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:51.480430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71105bb-3f2b-4ee7-8ed9-cf8e437d0534 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:51.513772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:51.517413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e9bec-46cb-4102-9939-8769a9a64368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:51.518450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e9bec-46cb-4102-9939-8769a9a64368 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:51.518783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e9bec-46cb-4102-9939-8769a9a64368 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:51.519072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e9bec-46cb-4102-9939-8769a9a64368 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:51.520320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e9bec-46cb-4102-9939-8769a9a64368 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:51.521783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e9bec-46cb-4102-9939-8769a9a64368 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:51.523577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 42/83] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:40:51 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:51.524357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e9bec-46cb-4102-9939-8769a9a64368 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:51.558718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 42/84] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:40:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:51.559317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73c56a-b9e4-4fbc-9e4e-db69e8a8f6bd None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:51.627686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e9bec-46cb-4102-9939-8769a9a64368 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:51.661730 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73c56a-b9e4-4fbc-9e4e-db69e8a8f6bd None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:51.664794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde4aa5-48d7-4e6c-b51e-f2ed96eba11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:51.665678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde4aa5-48d7-4e6c-b51e-f2ed96eba11e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:51.665996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde4aa5-48d7-4e6c-b51e-f2ed96eba11e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:51.666281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde4aa5-48d7-4e6c-b51e-f2ed96eba11e None admin] PATH_INFO: `/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:51.667504 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde4aa5-48d7-4e6c-b51e-f2ed96eba11e None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d1ccb3a22469bbe646d3ebef6e225)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:51.668982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde4aa5-48d7-4e6c-b51e-f2ed96eba11e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:51.670654 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 43/85] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:51 2022] GET /identity/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:51.671397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde4aa5-48d7-4e6c-b51e-f2ed96eba11e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:51.696495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93373e78-6a2e-4fa9-a5b3-8135bf6d5b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:51.697161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93373e78-6a2e-4fa9-a5b3-8135bf6d5b68 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:51.697442 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93373e78-6a2e-4fa9-a5b3-8135bf6d5b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:51.697728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93373e78-6a2e-4fa9-a5b3-8135bf6d5b68 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:51.698479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93373e78-6a2e-4fa9-a5b3-8135bf6d5b68 None admin] RBAC: Adding query filter params (name=member) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:51.698799 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93373e78-6a2e-4fa9-a5b3-8135bf6d5b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:51.699072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:51.700540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93373e78-6a2e-4fa9-a5b3-8135bf6d5b68 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:51.709556 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 43/86] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:40:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:51.710440 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93373e78-6a2e-4fa9-a5b3-8135bf6d5b68 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:51.732620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:51.774966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde4aa5-48d7-4e6c-b51e-f2ed96eba11e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:51.809503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88d697-ffc4-45e3-ad2d-1d2b432f1847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:51.810134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88d697-ffc4-45e3-ad2d-1d2b432f1847 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:51.810413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88d697-ffc4-45e3-ad2d-1d2b432f1847 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:51.810685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88d697-ffc4-45e3-ad2d-1d2b432f1847 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:51.811405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88d697-ffc4-45e3-ad2d-1d2b432f1847 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:51.811492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93373e78-6a2e-4fa9-a5b3-8135bf6d5b68 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:51.812876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88d697-ffc4-45e3-ad2d-1d2b432f1847 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:51.840075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 44/87] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:40:51 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:40:51.840906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88d697-ffc4-45e3-ad2d-1d2b432f1847 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:51.847199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734b507-de8b-4b8a-a2c4-4c77fd46ab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:51.847891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734b507-de8b-4b8a-a2c4-4c77fd46ab33 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:51.848178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734b507-de8b-4b8a-a2c4-4c77fd46ab33 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:51.848459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734b507-de8b-4b8a-a2c4-4c77fd46ab33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:51.849316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734b507-de8b-4b8a-a2c4-4c77fd46ab33 None admin] RBAC: Adding query filter params (role.id=764ea3c1356843bca6a7e706c6ba9a20, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b, user.id=1c0d1ccb3a22469bbe646d3ebef6e225) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:51.849635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734b507-de8b-4b8a-a2c4-4c77fd46ab33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:51.851211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734b507-de8b-4b8a-a2c4-4c77fd46ab33 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:51.861359 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 44/88] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:40:51 2022] GET /identity/v3/role_assignments?user.id=1c0d1ccb3a22469bbe646d3ebef6e225&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:51.862623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734b507-de8b-4b8a-a2c4-4c77fd46ab33 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:51.976480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:51.985490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:52.004353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734b507-de8b-4b8a-a2c4-4c77fd46ab33 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:52.012887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88d697-ffc4-45e3-ad2d-1d2b432f1847 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:52.055871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f25d29-19e4-494b-b858-3cd26c0fd0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:52.056543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f25d29-19e4-494b-b858-3cd26c0fd0df None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:52.056831 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f25d29-19e4-494b-b858-3cd26c0fd0df None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:52.057114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f25d29-19e4-494b-b858-3cd26c0fd0df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:52.061451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3210d-624f-454f-a594-72e57bdbf712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:52.062514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3210d-624f-454f-a594-72e57bdbf712 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:52.062774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3210d-624f-454f-a594-72e57bdbf712 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:52.063056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3210d-624f-454f-a594-72e57bdbf712 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:52.064297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3210d-624f-454f-a594-72e57bdbf712 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:52.065763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3210d-624f-454f-a594-72e57bdbf712 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:52.067699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 45/89] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:40:51 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:52.068471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3210d-624f-454f-a594-72e57bdbf712 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:52.146190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f25d29-19e4-494b-b858-3cd26c0fd0df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:52.147682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f25d29-19e4-494b-b858-3cd26c0fd0df None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:52.194859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3210d-624f-454f-a594-72e57bdbf712 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:52.243394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356422e-5008-4077-acf4-637e8318ba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:52.245146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356422e-5008-4077-acf4-637e8318ba45 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:52.245431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356422e-5008-4077-acf4-637e8318ba45 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:52.245708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356422e-5008-4077-acf4-637e8318ba45 None admin] PATH_INFO: `/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:52.248806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356422e-5008-4077-acf4-637e8318ba45 None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d1ccb3a22469bbe646d3ebef6e225)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:52.249741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356422e-5008-4077-acf4-637e8318ba45 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:52.252818 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 46/90] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:52 2022] GET /identity/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:52.254073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356422e-5008-4077-acf4-637e8318ba45 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:52.255800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:52.277362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:52.281261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 45/91] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:40:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:52.282523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f25d29-19e4-494b-b858-3cd26c0fd0df None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:52.376045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356422e-5008-4077-acf4-637e8318ba45 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:52.407472 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f25d29-19e4-494b-b858-3cd26c0fd0df None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:52.413658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7108616-b33f-478e-806b-468a556cd6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:52.414671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7108616-b33f-478e-806b-468a556cd6fd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:52.415175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7108616-b33f-478e-806b-468a556cd6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:52.415795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7108616-b33f-478e-806b-468a556cd6fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:52.416823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7108616-b33f-478e-806b-468a556cd6fd None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b, user.id=196de148ea764c458b8dc4b5fcb67ec4) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:52.417339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7108616-b33f-478e-806b-468a556cd6fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:52.419183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7108616-b33f-478e-806b-468a556cd6fd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:52.425813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 47/92] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:40:52 2022] GET /identity/v3/role_assignments?user.id=196de148ea764c458b8dc4b5fcb67ec4&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:52.427318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7108616-b33f-478e-806b-468a556cd6fd None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:52.467729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a1e37-a3dd-4118-86af-26e663fa7ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:52.468573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a1e37-a3dd-4118-86af-26e663fa7ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:52.469377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a1e37-a3dd-4118-86af-26e663fa7ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:52.469721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a1e37-a3dd-4118-86af-26e663fa7ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:52.536179 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:52.558519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a1e37-a3dd-4118-86af-26e663fa7ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:52.558519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a1e37-a3dd-4118-86af-26e663fa7ac6 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:52.568927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:52.602657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7108616-b33f-478e-806b-468a556cd6fd None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:52.669630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211efb1-0ab9-4b74-80ed-55458c33ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:52.670822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211efb1-0ab9-4b74-80ed-55458c33ad24 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:52.671233 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211efb1-0ab9-4b74-80ed-55458c33ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:52.671651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211efb1-0ab9-4b74-80ed-55458c33ad24 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:52.678994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211efb1-0ab9-4b74-80ed-55458c33ad24 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:52.680651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211efb1-0ab9-4b74-80ed-55458c33ad24 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:52.681424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 46/93] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:52.682980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 48/94] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:40:52 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:52.686855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a1e37-a3dd-4118-86af-26e663fa7ac6 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:52.691913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211efb1-0ab9-4b74-80ed-55458c33ad24 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:52.788229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:52.803141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a1e37-a3dd-4118-86af-26e663fa7ac6 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:52.842460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a791de7-a40e-4c18-a91a-958f038ce6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:52.843795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a791de7-a40e-4c18-a91a-958f038ce6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:52.844451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a791de7-a40e-4c18-a91a-958f038ce6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:52.845012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a791de7-a40e-4c18-a91a-958f038ce6f0 None admin] PATH_INFO: `/v3/projects/1cd2222d802944a886e177c05abb3640` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:52.846596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a791de7-a40e-4c18-a91a-958f038ce6f0 None admin] RBAC: Authorizing `identity:get_project(project_id=1cd2222d802944a886e177c05abb3640)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:52.848289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a791de7-a40e-4c18-a91a-958f038ce6f0 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:52.850564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 47/95] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:40:52 2022] GET /identity/v3/projects/1cd2222d802944a886e177c05abb3640 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:52.856446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a791de7-a40e-4c18-a91a-958f038ce6f0 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:52.883941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211efb1-0ab9-4b74-80ed-55458c33ad24 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:52.942704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3a01d-b031-4b8d-a8bd-0415b8767680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:52.943311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3a01d-b031-4b8d-a8bd-0415b8767680 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:52.943603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3a01d-b031-4b8d-a8bd-0415b8767680 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:52.943888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3a01d-b031-4b8d-a8bd-0415b8767680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:52.944753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3a01d-b031-4b8d-a8bd-0415b8767680 None admin] RBAC: Adding query filter params (role.id=ec1f98086b0748cf9d484264d6d60fff, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b, user.id=1c0d1ccb3a22469bbe646d3ebef6e225) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:52.945077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3a01d-b031-4b8d-a8bd-0415b8767680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:52.946580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3a01d-b031-4b8d-a8bd-0415b8767680 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:52.952575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 49/96] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:40:52 2022] GET /identity/v3/role_assignments?user.id=1c0d1ccb3a22469bbe646d3ebef6e225&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=ec1f98086b0748cf9d484264d6d60fff => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:52.974556 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a791de7-a40e-4c18-a91a-958f038ce6f0 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:53.016768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc2382-a6e0-499d-abc6-02bf07719fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:53.018271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc2382-a6e0-499d-abc6-02bf07719fde None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:53.018785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc2382-a6e0-499d-abc6-02bf07719fde None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:53.019261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc2382-a6e0-499d-abc6-02bf07719fde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:53.020413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc2382-a6e0-499d-abc6-02bf07719fde None admin] RBAC: Adding query filter params (role.id=764ea3c1356843bca6a7e706c6ba9a20, scope.project.id=1cd2222d802944a886e177c05abb3640, user.id=1c0d1ccb3a22469bbe646d3ebef6e225) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:53.020933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc2382-a6e0-499d-abc6-02bf07719fde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:53.022647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc2382-a6e0-499d-abc6-02bf07719fde None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:53.029441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 48/97] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:40:52 2022] GET /identity/v3/role_assignments?user.id=1c0d1ccb3a22469bbe646d3ebef6e225&scope.project.id=1cd2222d802944a886e177c05abb3640&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:55.086947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522b54-399e-48b1-ba53-4784b022f937 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:55.087417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522b54-399e-48b1-ba53-4784b022f937 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:55.087417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522b54-399e-48b1-ba53-4784b022f937 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:55.088812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 50/98] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:55.095296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43115d-aed2-4517-a03c-e940a9743111 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:55.095749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43115d-aed2-4517-a03c-e940a9743111 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:55.095932 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43115d-aed2-4517-a03c-e940a9743111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:55.126865 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-cd43115d-aed2-4517-a03c-e940a9743111 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:55.128101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-cd43115d-aed2-4517-a03c-e940a9743111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:55.143517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:55.221144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 49/99] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:55.259440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63522b54-399e-48b1-ba53-4784b022f937 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:55.291713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:55.402404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63522b54-399e-48b1-ba53-4784b022f937 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:55.441109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae2beb-607a-426d-9e4f-066a51edb001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:55.442065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae2beb-607a-426d-9e4f-066a51edb001 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:55.442358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae2beb-607a-426d-9e4f-066a51edb001 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:55.442642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae2beb-607a-426d-9e4f-066a51edb001 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:55.454725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae2beb-607a-426d-9e4f-066a51edb001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-bcae2beb-607a-426d-9e4f-066a51edb001 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:55.463267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:55.464265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:40:55.465060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 51/100] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:40:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:55.472140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43115d-aed2-4517-a03c-e940a9743111 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:55.633861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43115d-aed2-4517-a03c-e940a9743111 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:55.670618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a66be-101d-4b98-b93a-7df369c0ce74 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:55.670618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a66be-101d-4b98-b93a-7df369c0ce74 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:55.670618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a66be-101d-4b98-b93a-7df369c0ce74 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:55.670618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 52/101] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:55.678205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5961648-d24c-455d-ba68-6ffb1c153078 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:55.678497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5961648-d24c-455d-ba68-6ffb1c153078 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:55.678953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5961648-d24c-455d-ba68-6ffb1c153078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:55.713919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166bd9a-4ef9-4613-840b-c331ff57f29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:55.713919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166bd9a-4ef9-4613-840b-c331ff57f29b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:55.713919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166bd9a-4ef9-4613-840b-c331ff57f29b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:55.713919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166bd9a-4ef9-4613-840b-c331ff57f29b None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:55.714392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166bd9a-4ef9-4613-840b-c331ff57f29b None admin] RBAC: Adding query filter params (name=member) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:55.714392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166bd9a-4ef9-4613-840b-c331ff57f29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:55.714953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166bd9a-4ef9-4613-840b-c331ff57f29b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:55.715767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f5961648-d24c-455d-ba68-6ffb1c153078 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:55.717510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f5961648-d24c-455d-ba68-6ffb1c153078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:55.740348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 50/102] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:40:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:55.747207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166bd9a-4ef9-4613-840b-c331ff57f29b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:55.768293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:55.829696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 53/103] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:55.831338 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3828-5ddc-4604-b29b-eb147ef4bf9f None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:55.831759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3828-5ddc-4604-b29b-eb147ef4bf9f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:55.832181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3828-5ddc-4604-b29b-eb147ef4bf9f None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:55.833621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 54/104] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:55.834855 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799053a-9c27-4e6a-89ee-bb6940c619d7 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:55.835805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799053a-9c27-4e6a-89ee-bb6940c619d7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:55.836267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799053a-9c27-4e6a-89ee-bb6940c619d7 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:55.837848 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 55/105] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:55.839268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6498f-9ec8-4adf-816f-6981b42eb0ab None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:55.839741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6498f-9ec8-4adf-816f-6981b42eb0ab None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:55.840207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6498f-9ec8-4adf-816f-6981b42eb0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:55.848549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:55.869996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9dc6498f-9ec8-4adf-816f-6981b42eb0ab None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:55.872845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9dc6498f-9ec8-4adf-816f-6981b42eb0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:55.917062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166bd9a-4ef9-4613-840b-c331ff57f29b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:55.956602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c846a-0c9d-4237-bcf0-0b9db75ec0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:55.957468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c846a-0c9d-4237-bcf0-0b9db75ec0bc None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:55.957756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c846a-0c9d-4237-bcf0-0b9db75ec0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:55.958108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c846a-0c9d-4237-bcf0-0b9db75ec0bc None admin] PATH_INFO: `/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:55.959370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c846a-0c9d-4237-bcf0-0b9db75ec0bc None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d1ccb3a22469bbe646d3ebef6e225)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:55.960834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c846a-0c9d-4237-bcf0-0b9db75ec0bc None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:55.962680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 51/106] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:55 2022] GET /identity/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:55.963699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849f455-7665-4a78-b894-d9a4b2326a0c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:55.963978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849f455-7665-4a78-b894-d9a4b2326a0c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:55.964262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849f455-7665-4a78-b894-d9a4b2326a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:55.968367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 56/107] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:55.969517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6498f-9ec8-4adf-816f-6981b42eb0ab None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:55.982287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-7849f455-7665-4a78-b894-d9a4b2326a0c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:55.983649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7849f455-7665-4a78-b894-d9a4b2326a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:56.059042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 52/108] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:56.060192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389d515-c121-4778-886f-5bd75ff377b0 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.060483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389d515-c121-4778-886f-5bd75ff377b0 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.060767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389d515-c121-4778-886f-5bd75ff377b0 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.062074 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 53/109] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:56.063088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389d515-c121-4778-886f-5bd75ff377b0 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:56.076847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:56.086370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6498f-9ec8-4adf-816f-6981b42eb0ab None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:56.121874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae1ec8-c9c5-41ca-9657-c56c2e4b6eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:56.122828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae1ec8-c9c5-41ca-9657-c56c2e4b6eeb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.123110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae1ec8-c9c5-41ca-9657-c56c2e4b6eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.123400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae1ec8-c9c5-41ca-9657-c56c2e4b6eeb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.126031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:56.135596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae1ec8-c9c5-41ca-9657-c56c2e4b6eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-87ae1ec8-c9c5-41ca-9657-c56c2e4b6eeb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:56.145012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:56.146079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 57/110] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:40:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:56.147490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae1ec8-c9c5-41ca-9657-c56c2e4b6eeb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:56.189259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389d515-c121-4778-886f-5bd75ff377b0 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:56.232174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58307c9-e4bb-401e-a616-e6b51dc47224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:56.233190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58307c9-e4bb-401e-a616-e6b51dc47224 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.233453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58307c9-e4bb-401e-a616-e6b51dc47224 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.233844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58307c9-e4bb-401e-a616-e6b51dc47224 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.235313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58307c9-e4bb-401e-a616-e6b51dc47224 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:56.237062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58307c9-e4bb-401e-a616-e6b51dc47224 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:56.243670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 54/111] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:40:56 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:56.243670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356c1c8-11f2-4f9a-98a4-7feed3da4104 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.243670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356c1c8-11f2-4f9a-98a4-7feed3da4104 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.243670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356c1c8-11f2-4f9a-98a4-7feed3da4104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.260450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6356c1c8-11f2-4f9a-98a4-7feed3da4104 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:56.261653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6356c1c8-11f2-4f9a-98a4-7feed3da4104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:56.265007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae1ec8-c9c5-41ca-9657-c56c2e4b6eeb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:56.300610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6320ba-6409-4b57-ab4d-77b6d227d232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:56.301419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6320ba-6409-4b57-ab4d-77b6d227d232 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.301717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6320ba-6409-4b57-ab4d-77b6d227d232 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.302021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6320ba-6409-4b57-ab4d-77b6d227d232 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.312295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6320ba-6409-4b57-ab4d-77b6d227d232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-cc6320ba-6409-4b57-ab4d-77b6d227d232 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:56.320001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:56.320988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:40:56.321748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 58/112] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:56.322623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6320ba-6409-4b57-ab4d-77b6d227d232 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:56.333656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 55/113] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:56.334355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356c1c8-11f2-4f9a-98a4-7feed3da4104 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:56.345638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:56.379894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:56.428053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6320ba-6409-4b57-ab4d-77b6d227d232 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:56.447776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356c1c8-11f2-4f9a-98a4-7feed3da4104 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:56.464906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0b34f-9cc3-4daa-ac85-1158716f41b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:56.465122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0b34f-9cc3-4daa-ac85-1158716f41b7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.465299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0b34f-9cc3-4daa-ac85-1158716f41b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.465578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0b34f-9cc3-4daa-ac85-1158716f41b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.466836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0b34f-9cc3-4daa-ac85-1158716f41b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:56.468387 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0b34f-9cc3-4daa-ac85-1158716f41b7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:56.470719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 59/114] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:40:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:56.471953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0b34f-9cc3-4daa-ac85-1158716f41b7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:56.483962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4d5d2-de5d-4f68-8bb1-1896371f09ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:56.485422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d5d2-de5d-4f68-8bb1-1896371f09ba None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.485699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d5d2-de5d-4f68-8bb1-1896371f09ba None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.485997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d5d2-de5d-4f68-8bb1-1896371f09ba None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.486742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4d5d2-de5d-4f68-8bb1-1896371f09ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:56.487051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4d5d2-de5d-4f68-8bb1-1896371f09ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:56.488414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4d5d2-de5d-4f68-8bb1-1896371f09ba None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:56.496664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 56/115] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:40:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:56.500175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d92acc-5052-43b0-bede-cfb4501eb42b None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.500175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d92acc-5052-43b0-bede-cfb4501eb42b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.500175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d92acc-5052-43b0-bede-cfb4501eb42b None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.500175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 57/116] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:56.500675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d92acc-5052-43b0-bede-cfb4501eb42b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:56.575610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:56.584980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0b34f-9cc3-4daa-ac85-1158716f41b7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:56.608284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:56.614747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d92acc-5052-43b0-bede-cfb4501eb42b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:56.621023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d78e0b-bd0d-4c31-9feb-7d84195aa55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:56.621961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d78e0b-bd0d-4c31-9feb-7d84195aa55f None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.622257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d78e0b-bd0d-4c31-9feb-7d84195aa55f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.622536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d78e0b-bd0d-4c31-9feb-7d84195aa55f None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/users/1c0d1ccb3a22469bbe646d3ebef6e225/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.624550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d78e0b-bd0d-4c31-9feb-7d84195aa55f None admin] RBAC: Authorizing `identity:create_grant(project_id=e7c9534cee7f420a9b48f192ca318f6b, user_id=1c0d1ccb3a22469bbe646d3ebef6e225, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:56.626784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d78e0b-bd0d-4c31-9feb-7d84195aa55f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:56.639899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 60/117] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:40:56 2022] PUT /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/users/1c0d1ccb3a22469bbe646d3ebef6e225/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:40:56.640795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d78e0b-bd0d-4c31-9feb-7d84195aa55f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:56.650676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7978f-e780-4102-8185-b367f6ad4ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:56.651431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7978f-e780-4102-8185-b367f6ad4ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.651718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7978f-e780-4102-8185-b367f6ad4ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.652075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7978f-e780-4102-8185-b367f6ad4ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.652771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7978f-e780-4102-8185-b367f6ad4ca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:56.653081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7978f-e780-4102-8185-b367f6ad4ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:56.654592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7978f-e780-4102-8185-b367f6ad4ca5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:56.672973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 58/118] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:56.674875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7978f-e780-4102-8185-b367f6ad4ca5 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:56.785749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d78e0b-bd0d-4c31-9feb-7d84195aa55f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:56.803243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7978f-e780-4102-8185-b367f6ad4ca5 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:56.834492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940508-9e97-42ce-bee6-924d04e04bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:56.835292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940508-9e97-42ce-bee6-924d04e04bef None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.835576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940508-9e97-42ce-bee6-924d04e04bef None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.835849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940508-9e97-42ce-bee6-924d04e04bef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.836300 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:56.848433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5aa72-a3e7-4f3a-8c24-c11e11f1889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:56.849114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5aa72-a3e7-4f3a-8c24-c11e11f1889e None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.849394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5aa72-a3e7-4f3a-8c24-c11e11f1889e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.849687 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5aa72-a3e7-4f3a-8c24-c11e11f1889e None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.850235 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94940508-9e97-42ce-bee6-924d04e04bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:56.850422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5aa72-a3e7-4f3a-8c24-c11e11f1889e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:56.851889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5aa72-a3e7-4f3a-8c24-c11e11f1889e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-94940508-9e97-42ce-bee6-924d04e04bef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:56.858379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:56.859260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:40:56.860515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 61/119] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:56.861803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940508-9e97-42ce-bee6-924d04e04bef None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:56.883847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 59/120] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:40:56 2022] POST /identity/v3/projects => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:40:56.891955 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e94788-cc77-4c3a-ae51-3e3ddd369f8a None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:56.893107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e94788-cc77-4c3a-ae51-3e3ddd369f8a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:56.893556 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e94788-cc77-4c3a-ae51-3e3ddd369f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:56.919459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a2e94788-cc77-4c3a-ae51-3e3ddd369f8a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:56.920519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:56.923384 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a2e94788-cc77-4c3a-ae51-3e3ddd369f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:57.003357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940508-9e97-42ce-bee6-924d04e04bef None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:57.045746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 60/121] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:57.045746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e94788-cc77-4c3a-ae51-3e3ddd369f8a None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:57.058363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2d940-ca52-4725-8414-11d453237351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:57.059257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2d940-ca52-4725-8414-11d453237351 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:57.059549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2d940-ca52-4725-8414-11d453237351 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:57.059930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2d940-ca52-4725-8414-11d453237351 None admin] PATH_INFO: `/v3/users/c87a5ab70ff346cfbec80c7f48cd7ff4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:57.081130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2d940-ca52-4725-8414-11d453237351 None admin] RBAC: Authorizing `identity:get_user(user_id=c87a5ab70ff346cfbec80c7f48cd7ff4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:57.083078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2d940-ca52-4725-8414-11d453237351 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:57.085869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 62/122] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:56 2022] GET /identity/v3/users/c87a5ab70ff346cfbec80c7f48cd7ff4 => generated 289 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:57.090414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2d940-ca52-4725-8414-11d453237351 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:57.186449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e94788-cc77-4c3a-ae51-3e3ddd369f8a None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:57.202242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:57.219951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:57.225005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2d940-ca52-4725-8414-11d453237351 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:57.239566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc81684-5cf2-4d7e-b0ec-bf60661aaf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:57.240635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc81684-5cf2-4d7e-b0ec-bf60661aaf04 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:57.240921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc81684-5cf2-4d7e-b0ec-bf60661aaf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:57.241580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc81684-5cf2-4d7e-b0ec-bf60661aaf04 None admin] PATH_INFO: `/v3/users/196de148ea764c458b8dc4b5fcb67ec4` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:57.243068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc81684-5cf2-4d7e-b0ec-bf60661aaf04 None admin] RBAC: Authorizing `identity:get_user(user_id=196de148ea764c458b8dc4b5fcb67ec4)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:57.245061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc81684-5cf2-4d7e-b0ec-bf60661aaf04 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:57.247053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 61/123] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:57 2022] GET /identity/v3/users/196de148ea764c458b8dc4b5fcb67ec4 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:57.248287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc81684-5cf2-4d7e-b0ec-bf60661aaf04 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:57.264963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071528c8-50cd-4e0e-a76e-61708c8b0018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:57.266449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071528c8-50cd-4e0e-a76e-61708c8b0018 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:57.266738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071528c8-50cd-4e0e-a76e-61708c8b0018 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:57.267022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071528c8-50cd-4e0e-a76e-61708c8b0018 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:57.267892 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071528c8-50cd-4e0e-a76e-61708c8b0018 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:57.268210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071528c8-50cd-4e0e-a76e-61708c8b0018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:57.269617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071528c8-50cd-4e0e-a76e-61708c8b0018 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:57.279755 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 63/124] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:40:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:57.280568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071528c8-50cd-4e0e-a76e-61708c8b0018 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:57.358279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc81684-5cf2-4d7e-b0ec-bf60661aaf04 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:57.395566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071528c8-50cd-4e0e-a76e-61708c8b0018 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:57.397524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25258345-ca9b-49ac-b1a6-6883edf2ce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:57.398491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25258345-ca9b-49ac-b1a6-6883edf2ce51 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:57.398877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25258345-ca9b-49ac-b1a6-6883edf2ce51 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:57.399255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25258345-ca9b-49ac-b1a6-6883edf2ce51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:57.411718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25258345-ca9b-49ac-b1a6-6883edf2ce51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-25258345-ca9b-49ac-b1a6-6883edf2ce51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:57.420044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:57.422423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:40:57.424279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 62/125] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:40:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:57.425722 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25258345-ca9b-49ac-b1a6-6883edf2ce51 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:57.437085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec6a40-3731-476e-92cd-9697831df625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:57.438088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec6a40-3731-476e-92cd-9697831df625 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:57.438459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec6a40-3731-476e-92cd-9697831df625 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:57.438735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec6a40-3731-476e-92cd-9697831df625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:57.470191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:57.476417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:57.522800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec6a40-3731-476e-92cd-9697831df625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:57.524481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec6a40-3731-476e-92cd-9697831df625 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:57.539721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25258345-ca9b-49ac-b1a6-6883edf2ce51 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:57.576253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196afa4-c127-4da2-9c25-47ac31a9889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:57.577232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196afa4-c127-4da2-9c25-47ac31a9889f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:57.577588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196afa4-c127-4da2-9c25-47ac31a9889f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:57.578605 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196afa4-c127-4da2-9c25-47ac31a9889f None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:57.580305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196afa4-c127-4da2-9c25-47ac31a9889f None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:57.581864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196afa4-c127-4da2-9c25-47ac31a9889f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:57.583669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 63/126] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:40:57 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:57.584496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196afa4-c127-4da2-9c25-47ac31a9889f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:57.633790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 64/127] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:57.634696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec6a40-3731-476e-92cd-9697831df625 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:57.704247 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:57.712051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196afa4-c127-4da2-9c25-47ac31a9889f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:57.719981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:57.745313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec6a40-3731-476e-92cd-9697831df625 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:57.752422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c3e1c-8656-458e-a88c-a13884b0a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:57.753667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c3e1c-8656-458e-a88c-a13884b0a634 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:57.754192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c3e1c-8656-458e-a88c-a13884b0a634 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:57.754474 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c3e1c-8656-458e-a88c-a13884b0a634 None admin] PATH_INFO: `/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:57.755821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c3e1c-8656-458e-a88c-a13884b0a634 None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d1ccb3a22469bbe646d3ebef6e225)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:57.757535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c3e1c-8656-458e-a88c-a13884b0a634 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:57.759235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 64/128] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:57 2022] GET /identity/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:57.759978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c3e1c-8656-458e-a88c-a13884b0a634 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:57.783257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566699b9-9690-4d61-9988-86500ef52f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:57.783947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566699b9-9690-4d61-9988-86500ef52f88 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:57.784237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566699b9-9690-4d61-9988-86500ef52f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:57.784667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566699b9-9690-4d61-9988-86500ef52f88 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:57.785602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566699b9-9690-4d61-9988-86500ef52f88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:57.785979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566699b9-9690-4d61-9988-86500ef52f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:57.787402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566699b9-9690-4d61-9988-86500ef52f88 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:57.796950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 65/129] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:40:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:57.798085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566699b9-9690-4d61-9988-86500ef52f88 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:57.873081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c3e1c-8656-458e-a88c-a13884b0a634 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:57.905143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566699b9-9690-4d61-9988-86500ef52f88 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:57.908930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe34666-fc84-45b9-bca4-31fab86364f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:57.909833 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe34666-fc84-45b9-bca4-31fab86364f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:57.910154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe34666-fc84-45b9-bca4-31fab86364f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:57.910431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe34666-fc84-45b9-bca4-31fab86364f6 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/users/196de148ea764c458b8dc4b5fcb67ec4/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:57.912480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe34666-fc84-45b9-bca4-31fab86364f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7c9534cee7f420a9b48f192ca318f6b, user_id=196de148ea764c458b8dc4b5fcb67ec4, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:57.913965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe34666-fc84-45b9-bca4-31fab86364f6 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:57.931429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:57.932561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 65/130] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:40:57 2022] PUT /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/users/196de148ea764c458b8dc4b5fcb67ec4/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:40:57.933634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe34666-fc84-45b9-bca4-31fab86364f6 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:57.944497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aae94-3f67-4cb6-9293-118b96594e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:57.945515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aae94-3f67-4cb6-9293-118b96594e34 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:57.949974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aae94-3f67-4cb6-9293-118b96594e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:57.950429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aae94-3f67-4cb6-9293-118b96594e34 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:57.951896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aae94-3f67-4cb6-9293-118b96594e34 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:57.963840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aae94-3f67-4cb6-9293-118b96594e34 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:57.966143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 66/131] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:40:57 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:57.966898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aae94-3f67-4cb6-9293-118b96594e34 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:57.994361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:58.061867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe34666-fc84-45b9-bca4-31fab86364f6 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:58.106698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6c3fd-21ef-42fb-9793-742e6f519eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:58.107072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c3fd-21ef-42fb-9793-742e6f519eab None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:58.107877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c3fd-21ef-42fb-9793-742e6f519eab None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:58.107877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c3fd-21ef-42fb-9793-742e6f519eab None admin] PATH_INFO: `/v3/projects/1cd2222d802944a886e177c05abb3640` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:58.110096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6c3fd-21ef-42fb-9793-742e6f519eab None admin] RBAC: Authorizing `identity:get_project(project_id=1cd2222d802944a886e177c05abb3640)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:58.111158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6c3fd-21ef-42fb-9793-742e6f519eab None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:58.112765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 66/132] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:40:57 2022] GET /identity/v3/projects/1cd2222d802944a886e177c05abb3640 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:58.117550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6c3fd-21ef-42fb-9793-742e6f519eab None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:58.182636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aae94-3f67-4cb6-9293-118b96594e34 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:58.221861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6c3fd-21ef-42fb-9793-742e6f519eab None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:58.222405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8539c-4555-474f-9c6d-588287153234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:58.222879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8539c-4555-474f-9c6d-588287153234 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:58.223066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8539c-4555-474f-9c6d-588287153234 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:58.223584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:58.223997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8539c-4555-474f-9c6d-588287153234 None admin] PATH_INFO: `/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:58.225330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8539c-4555-474f-9c6d-588287153234 None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d1ccb3a22469bbe646d3ebef6e225)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:58.226903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8539c-4555-474f-9c6d-588287153234 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:58.228580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 67/133] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:57 2022] GET /identity/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:58.229416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8539c-4555-474f-9c6d-588287153234 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:58.261296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14d1bb-e25b-4be7-ae8c-fb729921495c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:58.261996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d1bb-e25b-4be7-ae8c-fb729921495c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:58.262533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d1bb-e25b-4be7-ae8c-fb729921495c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:58.262808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d1bb-e25b-4be7-ae8c-fb729921495c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:58.263700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14d1bb-e25b-4be7-ae8c-fb729921495c None admin] RBAC: Adding query filter params (role.id=8465efbb92344621a8ddda3834211a46, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b, user.id=c87a5ab70ff346cfbec80c7f48cd7ff4) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:58.264014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14d1bb-e25b-4be7-ae8c-fb729921495c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:58.266180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14d1bb-e25b-4be7-ae8c-fb729921495c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:58.273067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 67/134] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:40:58 2022] GET /identity/v3/role_assignments?user.id=c87a5ab70ff346cfbec80c7f48cd7ff4&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=8465efbb92344621a8ddda3834211a46 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:58.273964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14d1bb-e25b-4be7-ae8c-fb729921495c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:58.304748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:58.352055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8539c-4555-474f-9c6d-588287153234 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:58.391554 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8619420-d114-4521-9a0d-67d55e2953a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:58.392475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619420-d114-4521-9a0d-67d55e2953a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:58.392763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619420-d114-4521-9a0d-67d55e2953a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:58.393045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8619420-d114-4521-9a0d-67d55e2953a7 None admin] PATH_INFO: `/v3/projects/1cd2222d802944a886e177c05abb3640/users/1c0d1ccb3a22469bbe646d3ebef6e225/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:58.395117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8619420-d114-4521-9a0d-67d55e2953a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2222d802944a886e177c05abb3640, user_id=1c0d1ccb3a22469bbe646d3ebef6e225, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:58.396581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8619420-d114-4521-9a0d-67d55e2953a7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:58.419551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 68/135] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:40:58 2022] PUT /identity/v3/projects/1cd2222d802944a886e177c05abb3640/users/1c0d1ccb3a22469bbe646d3ebef6e225/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:40:58.472448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14d1bb-e25b-4be7-ae8c-fb729921495c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:58.526157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24cc41-33a3-4e13-b3a8-157ad704ee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:58.527052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24cc41-33a3-4e13-b3a8-157ad704ee80 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:58.527343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24cc41-33a3-4e13-b3a8-157ad704ee80 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:58.527628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24cc41-33a3-4e13-b3a8-157ad704ee80 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:58.528912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24cc41-33a3-4e13-b3a8-157ad704ee80 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:58.530450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24cc41-33a3-4e13-b3a8-157ad704ee80 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:58.537599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 68/136] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:40:58 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:58.538617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8619420-d114-4521-9a0d-67d55e2953a7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:58.690334 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8619420-d114-4521-9a0d-67d55e2953a7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:58.724623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:58.745182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6618058-6b34-4cd9-bc56-efc4937bf318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:58.746117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6618058-6b34-4cd9-bc56-efc4937bf318 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:58.746400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6618058-6b34-4cd9-bc56-efc4937bf318 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:58.746678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6618058-6b34-4cd9-bc56-efc4937bf318 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/users/1c0d1ccb3a22469bbe646d3ebef6e225/roles/ec1f98086b0748cf9d484264d6d60fff` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:58.749951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6618058-6b34-4cd9-bc56-efc4937bf318 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7c9534cee7f420a9b48f192ca318f6b, user_id=1c0d1ccb3a22469bbe646d3ebef6e225, role_id=ec1f98086b0748cf9d484264d6d60fff)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:58.752492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6618058-6b34-4cd9-bc56-efc4937bf318 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:58.771132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 69/137] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:40:58 2022] PUT /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/users/1c0d1ccb3a22469bbe646d3ebef6e225/roles/ec1f98086b0748cf9d484264d6d60fff => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:40:59.126442 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba910def-4d54-46cb-9177-f5e90ad23142 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:59.126833 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba910def-4d54-46cb-9177-f5e90ad23142 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:59.127018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba910def-4d54-46cb-9177-f5e90ad23142 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:59.128439 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 69/138] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:40:59.134209 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7adbd7-fde8-4b55-b18a-7a4fb5adaafe None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:59.134502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7adbd7-fde8-4b55-b18a-7a4fb5adaafe None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:59.134785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7adbd7-fde8-4b55-b18a-7a4fb5adaafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:59.156923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8c7adbd7-fde8-4b55-b18a-7a4fb5adaafe None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:59.158179 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8c7adbd7-fde8-4b55-b18a-7a4fb5adaafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:59.238510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 70/139] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:59.271332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba910def-4d54-46cb-9177-f5e90ad23142 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:59.329402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:59.405180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba910def-4d54-46cb-9177-f5e90ad23142 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:59.445219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6932b3-498b-44d3-88f1-383190877f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:59.446050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6932b3-498b-44d3-88f1-383190877f14 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:59.446340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6932b3-498b-44d3-88f1-383190877f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:59.446618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6932b3-498b-44d3-88f1-383190877f14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:59.463260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6932b3-498b-44d3-88f1-383190877f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-9c6932b3-498b-44d3-88f1-383190877f14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:40:59.471942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:40:59.472829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:40:59.473569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:40:59.475693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 70/140] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:40:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:40:59.480593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7adbd7-fde8-4b55-b18a-7a4fb5adaafe None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:59.610815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7adbd7-fde8-4b55-b18a-7a4fb5adaafe None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:59.622332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:59.656742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b1612-4ce3-4c11-93c2-ca3b3a73d0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:59.656742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b1612-4ce3-4c11-93c2-ca3b3a73d0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:59.656742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b1612-4ce3-4c11-93c2-ca3b3a73d0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:59.656742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b1612-4ce3-4c11-93c2-ca3b3a73d0d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:59.657112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b1612-4ce3-4c11-93c2-ca3b3a73d0d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:40:59.657112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b1612-4ce3-4c11-93c2-ca3b3a73d0d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:59.660273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b1612-4ce3-4c11-93c2-ca3b3a73d0d0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:59.677840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 71/141] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:40:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:59.683330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6932b3-498b-44d3-88f1-383190877f14 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:40:59.847510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee497b99-21b5-415b-989a-b5399efdb989 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:59.847881 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee497b99-21b5-415b-989a-b5399efdb989 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:59.848066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee497b99-21b5-415b-989a-b5399efdb989 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:59.849584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 72/142] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:40:59.854324 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b252c2-1dbb-4989-b50a-5867bd469d47 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:59.854614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b252c2-1dbb-4989-b50a-5867bd469d47 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:59.854911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b252c2-1dbb-4989-b50a-5867bd469d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:59.860224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:59.867730 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6932b3-498b-44d3-88f1-383190877f14 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:40:59.873423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-10b252c2-1dbb-4989-b50a-5867bd469d47 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:40:59.875591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-10b252c2-1dbb-4989-b50a-5867bd469d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:40:59.922200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83d828-3640-4b25-a5a9-b5e8dec4d9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:40:59.923437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83d828-3640-4b25-a5a9-b5e8dec4d9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:40:59.923912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83d828-3640-4b25-a5a9-b5e8dec4d9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:40:59.924479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83d828-3640-4b25-a5a9-b5e8dec4d9a4 None admin] PATH_INFO: `/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:40:59.926995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83d828-3640-4b25-a5a9-b5e8dec4d9a4 None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d1ccb3a22469bbe646d3ebef6e225)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:40:59.928682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83d828-3640-4b25-a5a9-b5e8dec4d9a4 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:40:59.931318 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 71/143] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:40:59 2022] GET /identity/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:40:59.937080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83d828-3640-4b25-a5a9-b5e8dec4d9a4 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:00.010193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 73/144] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:00.033203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b252c2-1dbb-4989-b50a-5867bd469d47 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:00.150676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83d828-3640-4b25-a5a9-b5e8dec4d9a4 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:00.189783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b252c2-1dbb-4989-b50a-5867bd469d47 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:00.202389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:00.228401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daea79-5357-4c33-81dc-2a02488dad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:00.229142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daea79-5357-4c33-81dc-2a02488dad1a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:00.229435 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daea79-5357-4c33-81dc-2a02488dad1a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:00.229720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daea79-5357-4c33-81dc-2a02488dad1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:00.252168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cbe68-6c1c-463e-8333-aaea635ef837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:00.252987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cbe68-6c1c-463e-8333-aaea635ef837 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:00.253264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cbe68-6c1c-463e-8333-aaea635ef837 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:00.253534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cbe68-6c1c-463e-8333-aaea635ef837 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:00.255997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0cbe68-6c1c-463e-8333-aaea635ef837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:00.257469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0cbe68-6c1c-463e-8333-aaea635ef837 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:00.259308 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 74/145] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:00.266597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cbe68-6c1c-463e-8333-aaea635ef837 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:00.293903 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:00.385399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daea79-5357-4c33-81dc-2a02488dad1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:00.387028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daea79-5357-4c33-81dc-2a02488dad1a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:00.420786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cbe68-6c1c-463e-8333-aaea635ef837 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:00.470724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2056a1-6257-4ae6-8ac9-b5efe3593b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:00.471346 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2056a1-6257-4ae6-8ac9-b5efe3593b2e None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:00.471742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2056a1-6257-4ae6-8ac9-b5efe3593b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:00.472025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2056a1-6257-4ae6-8ac9-b5efe3593b2e None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:00.472754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2056a1-6257-4ae6-8ac9-b5efe3593b2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:00.474229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2056a1-6257-4ae6-8ac9-b5efe3593b2e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:00.505036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 75/146] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:41:00 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:41:00.589734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 72/147] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:40:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:00.595707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2056a1-6257-4ae6-8ac9-b5efe3593b2e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:00.643816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:00.762528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2056a1-6257-4ae6-8ac9-b5efe3593b2e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:00.815312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005de48d-6aa5-4892-a214-3a4d900dee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:00.816208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005de48d-6aa5-4892-a214-3a4d900dee49 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:00.816492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005de48d-6aa5-4892-a214-3a4d900dee49 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:00.816767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005de48d-6aa5-4892-a214-3a4d900dee49 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:00.818083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005de48d-6aa5-4892-a214-3a4d900dee49 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:00.819558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005de48d-6aa5-4892-a214-3a4d900dee49 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:00.821309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 76/148] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:00 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:00.827618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daea79-5357-4c33-81dc-2a02488dad1a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:00.941436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:00.994886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daea79-5357-4c33-81dc-2a02488dad1a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:01.051018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85deb188-8ed1-426d-b1a4-0ab9339abbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:01.051616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deb188-8ed1-426d-b1a4-0ab9339abbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:01.051900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deb188-8ed1-426d-b1a4-0ab9339abbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:01.052178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deb188-8ed1-426d-b1a4-0ab9339abbf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:01.053028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85deb188-8ed1-426d-b1a4-0ab9339abbf7 None admin] RBAC: Adding query filter params (role.id=764ea3c1356843bca6a7e706c6ba9a20, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b, user.id=1c0d1ccb3a22469bbe646d3ebef6e225) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:01.053344 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85deb188-8ed1-426d-b1a4-0ab9339abbf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:01.054854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85deb188-8ed1-426d-b1a4-0ab9339abbf7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:01.067406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 73/149] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:00 2022] GET /identity/v3/role_assignments?user.id=1c0d1ccb3a22469bbe646d3ebef6e225&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:01.443377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674036e-e5d1-473d-862a-e55653dedc61 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:01.444400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674036e-e5d1-473d-862a-e55653dedc61 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:01.444887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674036e-e5d1-473d-862a-e55653dedc61 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:01.446609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 77/150] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:01.453372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5a290-3212-4f39-a0e1-85b07b632ad6 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:01.454286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5a290-3212-4f39-a0e1-85b07b632ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:01.454765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5a290-3212-4f39-a0e1-85b07b632ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:01.473711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-13e5a290-3212-4f39-a0e1-85b07b632ad6 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:01.475389 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-13e5a290-3212-4f39-a0e1-85b07b632ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:01.564993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 74/151] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:01.574714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d97d69-fda9-49b3-a48a-d57b49062320 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:01.575371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d97d69-fda9-49b3-a48a-d57b49062320 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:01.575884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d97d69-fda9-49b3-a48a-d57b49062320 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:01.577554 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 78/152] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:01.587985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dee03-0465-4366-8dd0-e13891216ac2 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:01.588603 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dee03-0465-4366-8dd0-e13891216ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:01.589084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dee03-0465-4366-8dd0-e13891216ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:01.590772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d97d69-fda9-49b3-a48a-d57b49062320 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:01.612304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c23dee03-0465-4366-8dd0-e13891216ac2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:01.613843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c23dee03-0465-4366-8dd0-e13891216ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:01.688389 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:01.723232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 75/153] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:01.724733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071fe90-99a7-4870-9413-e22e5fbd4c88 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:01.725023 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071fe90-99a7-4870-9413-e22e5fbd4c88 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:01.726179 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071fe90-99a7-4870-9413-e22e5fbd4c88 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:01.730725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 76/154] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:01.737037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c8383-5406-492b-acf1-622295a5c74d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:01.737309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c8383-5406-492b-acf1-622295a5c74d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:01.737588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c8383-5406-492b-acf1-622295a5c74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:01.756974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:01.758068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-e72c8383-5406-492b-acf1-622295a5c74d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:01.759297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e72c8383-5406-492b-acf1-622295a5c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:01.767346 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d97d69-fda9-49b3-a48a-d57b49062320 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:01.808717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfe96f-4bd4-46a1-ab60-9ff4e6d0caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:01.809917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe96f-4bd4-46a1-ab60-9ff4e6d0caed None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:01.810401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe96f-4bd4-46a1-ab60-9ff4e6d0caed None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:01.810885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe96f-4bd4-46a1-ab60-9ff4e6d0caed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:01.830040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfe96f-4bd4-46a1-ab60-9ff4e6d0caed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-36bfe96f-4bd4-46a1-ab60-9ff4e6d0caed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:01.841524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:01.842500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:01.843614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:01.847199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 79/155] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:41:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:41:01.847642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 77/156] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:01.848534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfe96f-4bd4-46a1-ab60-9ff4e6d0caed None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:01.856303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c8383-5406-492b-acf1-622295a5c74d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:01.990998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfe96f-4bd4-46a1-ab60-9ff4e6d0caed None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:01.992072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c8383-5406-492b-acf1-622295a5c74d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:02.011654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:02.039316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0787a3-671a-4da9-8fae-16fb081dbde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:02.040013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0787a3-671a-4da9-8fae-16fb081dbde5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:02.040299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0787a3-671a-4da9-8fae-16fb081dbde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:02.040601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0787a3-671a-4da9-8fae-16fb081dbde5 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:02.041360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0787a3-671a-4da9-8fae-16fb081dbde5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:02.041671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0787a3-671a-4da9-8fae-16fb081dbde5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:02.043138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0787a3-671a-4da9-8fae-16fb081dbde5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:02.043386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1e935-81b2-4459-b780-f2e899d41f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:02.044419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1e935-81b2-4459-b780-f2e899d41f36 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:02.044895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1e935-81b2-4459-b780-f2e899d41f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:02.045350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1e935-81b2-4459-b780-f2e899d41f36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:02.055587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 78/157] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:02.056197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0787a3-671a-4da9-8fae-16fb081dbde5 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:02.063348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1e935-81b2-4459-b780-f2e899d41f36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-6bd1e935-81b2-4459-b780-f2e899d41f36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:02.072271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:02.073409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:02.074203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:02.076679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 80/158] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:02.077716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1e935-81b2-4459-b780-f2e899d41f36 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:02.105038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:02.182425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0787a3-671a-4da9-8fae-16fb081dbde5 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:02.236375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b99bc2-531f-4af8-ba19-ab114e7bb409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:02.237192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99bc2-531f-4af8-ba19-ab114e7bb409 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:02.237478 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99bc2-531f-4af8-ba19-ab114e7bb409 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:02.237758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99bc2-531f-4af8-ba19-ab114e7bb409 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:02.258842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b99bc2-531f-4af8-ba19-ab114e7bb409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-a8b99bc2-531f-4af8-ba19-ab114e7bb409 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:02.266991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:02.267869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:02.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 79/159] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:02.269337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b99bc2-531f-4af8-ba19-ab114e7bb409 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:02.271051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1e935-81b2-4459-b780-f2e899d41f36 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:02.317310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:02.366697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee8ae0-7a36-432b-895e-ca42f1e15440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:02.367664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee8ae0-7a36-432b-895e-ca42f1e15440 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:02.367950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee8ae0-7a36-432b-895e-ca42f1e15440 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:02.368226 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee8ae0-7a36-432b-895e-ca42f1e15440 None admin] PATH_INFO: `/v3/users/196de148ea764c458b8dc4b5fcb67ec4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:02.370144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee8ae0-7a36-432b-895e-ca42f1e15440 None admin] RBAC: Authorizing `identity:get_user(user_id=196de148ea764c458b8dc4b5fcb67ec4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:02.371689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee8ae0-7a36-432b-895e-ca42f1e15440 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:02.373697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 81/160] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:02 2022] GET /identity/v3/users/196de148ea764c458b8dc4b5fcb67ec4 => generated 247 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:02.374547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee8ae0-7a36-432b-895e-ca42f1e15440 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:02.447889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b99bc2-531f-4af8-ba19-ab114e7bb409 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:02.486600 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:02.509739 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee8ae0-7a36-432b-895e-ca42f1e15440 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:02.510051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90562f0-7b9b-4f2b-abaa-9828a0381742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:02.510849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90562f0-7b9b-4f2b-abaa-9828a0381742 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:02.511225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90562f0-7b9b-4f2b-abaa-9828a0381742 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:02.511591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90562f0-7b9b-4f2b-abaa-9828a0381742 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:02.512785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90562f0-7b9b-4f2b-abaa-9828a0381742 None admin] RBAC: Adding query filter params (name=member) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:02.513186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90562f0-7b9b-4f2b-abaa-9828a0381742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:02.514821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90562f0-7b9b-4f2b-abaa-9828a0381742 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:02.524631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 80/161] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:02.525470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90562f0-7b9b-4f2b-abaa-9828a0381742 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:02.571946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6148f03-6b84-4506-bcb8-2c395e557de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:02.573017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6148f03-6b84-4506-bcb8-2c395e557de7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:02.573449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6148f03-6b84-4506-bcb8-2c395e557de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:02.573917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6148f03-6b84-4506-bcb8-2c395e557de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:02.574823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6148f03-6b84-4506-bcb8-2c395e557de7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:02.575370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6148f03-6b84-4506-bcb8-2c395e557de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:02.577049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6148f03-6b84-4506-bcb8-2c395e557de7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:02.597711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 82/162] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:02.599425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b6dee-9453-4462-8e47-1a78b29f098a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:02.599860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b6dee-9453-4462-8e47-1a78b29f098a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:02.600281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b6dee-9453-4462-8e47-1a78b29f098a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:02.606135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 83/163] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:02.611920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b6dee-9453-4462-8e47-1a78b29f098a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:02.643435 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:02.647043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90562f0-7b9b-4f2b-abaa-9828a0381742 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:02.686595 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af2ad3-224e-485c-9061-868a5daac083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:02.687647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af2ad3-224e-485c-9061-868a5daac083 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:02.687929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af2ad3-224e-485c-9061-868a5daac083 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:02.688201 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af2ad3-224e-485c-9061-868a5daac083 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:02.773706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b6dee-9453-4462-8e47-1a78b29f098a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:02.814007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7412a-35f2-457c-b1cc-3974f758e9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:02.814921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7412a-35f2-457c-b1cc-3974f758e9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:02.815337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7412a-35f2-457c-b1cc-3974f758e9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:02.815723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7412a-35f2-457c-b1cc-3974f758e9b4 None admin] PATH_INFO: `/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:02.822804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7412a-35f2-457c-b1cc-3974f758e9b4 None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d1ccb3a22469bbe646d3ebef6e225)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:02.824295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7412a-35f2-457c-b1cc-3974f758e9b4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:02.826049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 84/164] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:02 2022] GET /identity/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:02.827243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106d2cb-45ab-42ed-add3-52f6103ec78d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:02.827573 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106d2cb-45ab-42ed-add3-52f6103ec78d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:02.828489 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106d2cb-45ab-42ed-add3-52f6103ec78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:02.850061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d106d2cb-45ab-42ed-add3-52f6103ec78d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:02.851495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d106d2cb-45ab-42ed-add3-52f6103ec78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:02.861984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:02.878886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af2ad3-224e-485c-9061-868a5daac083 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:02.880456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af2ad3-224e-485c-9061-868a5daac083 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:02.932817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 85/165] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:02.933854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106d2cb-45ab-42ed-add3-52f6103ec78d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:03.053315 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106d2cb-45ab-42ed-add3-52f6103ec78d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:03.097604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a7524-2542-484b-a260-cb9d129636d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:03.099200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a7524-2542-484b-a260-cb9d129636d4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:03.099619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a7524-2542-484b-a260-cb9d129636d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:03.100026 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a7524-2542-484b-a260-cb9d129636d4 None admin] PATH_INFO: `/v3/users/c87a5ab70ff346cfbec80c7f48cd7ff4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:03.102430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a7524-2542-484b-a260-cb9d129636d4 None admin] RBAC: Authorizing `identity:get_user(user_id=c87a5ab70ff346cfbec80c7f48cd7ff4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:03.104660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a7524-2542-484b-a260-cb9d129636d4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:03.107618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 86/166] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:02 2022] GET /identity/v3/users/c87a5ab70ff346cfbec80c7f48cd7ff4 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:03.109720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a7524-2542-484b-a260-cb9d129636d4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:03.132839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:03.249834 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a7524-2542-484b-a260-cb9d129636d4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:03.254073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:03.268849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 81/167] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:03.269735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af2ad3-224e-485c-9061-868a5daac083 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:03.298511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc79d9f-cd7d-43eb-b3b2-286b1b991ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:03.299253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc79d9f-cd7d-43eb-b3b2-286b1b991ecb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:03.299611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc79d9f-cd7d-43eb-b3b2-286b1b991ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:03.299916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc79d9f-cd7d-43eb-b3b2-286b1b991ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:03.438348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc79d9f-cd7d-43eb-b3b2-286b1b991ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:03.440044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc79d9f-cd7d-43eb-b3b2-286b1b991ecb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:03.459637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:03.471637 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af2ad3-224e-485c-9061-868a5daac083 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:03.547258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edac43-d1f4-42d3-afd6-ecd4d00a5583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:03.548107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edac43-d1f4-42d3-afd6-ecd4d00a5583 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:03.548393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edac43-d1f4-42d3-afd6-ecd4d00a5583 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:03.548671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edac43-d1f4-42d3-afd6-ecd4d00a5583 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:03.570210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edac43-d1f4-42d3-afd6-ecd4d00a5583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-f7edac43-d1f4-42d3-afd6-ecd4d00a5583 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:03.586911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:03.587867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:03.588650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:03.594034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 82/168] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:41:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:03.594906 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edac43-d1f4-42d3-afd6-ecd4d00a5583 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:03.650175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 87/169] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:03.651045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc79d9f-cd7d-43eb-b3b2-286b1b991ecb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:03.718315 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:03.807889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edac43-d1f4-42d3-afd6-ecd4d00a5583 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:03.829004 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc79d9f-cd7d-43eb-b3b2-286b1b991ecb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:03.841560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:03.897427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978db579-56a0-43ea-941b-b4a0080b99e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:03.898364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978db579-56a0-43ea-941b-b4a0080b99e5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:03.898646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978db579-56a0-43ea-941b-b4a0080b99e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:03.898917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978db579-56a0-43ea-941b-b4a0080b99e5 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:03.900317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953ac5d-7dbc-4cc9-a10e-4eb8bc9bba5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:03.901501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953ac5d-7dbc-4cc9-a10e-4eb8bc9bba5a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:03.902059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953ac5d-7dbc-4cc9-a10e-4eb8bc9bba5a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:03.902538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953ac5d-7dbc-4cc9-a10e-4eb8bc9bba5a None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:03.902780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978db579-56a0-43ea-941b-b4a0080b99e5 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:03.904254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978db579-56a0-43ea-941b-b4a0080b99e5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:03.904360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953ac5d-7dbc-4cc9-a10e-4eb8bc9bba5a None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:03.906081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953ac5d-7dbc-4cc9-a10e-4eb8bc9bba5a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:03.906422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 88/170] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:03 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:03.907318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978db579-56a0-43ea-941b-b4a0080b99e5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:03.909016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 83/171] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:03 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:03.910122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953ac5d-7dbc-4cc9-a10e-4eb8bc9bba5a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:04.037627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953ac5d-7dbc-4cc9-a10e-4eb8bc9bba5a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:04.051089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978db579-56a0-43ea-941b-b4a0080b99e5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:04.066799 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:04.075899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745009-71cd-4c0f-81be-223e0fa04e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:04.077028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745009-71cd-4c0f-81be-223e0fa04e28 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:04.077386 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745009-71cd-4c0f-81be-223e0fa04e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:04.077689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745009-71cd-4c0f-81be-223e0fa04e28 None admin] PATH_INFO: `/v3/projects/1cd2222d802944a886e177c05abb3640` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:04.079678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7745009-71cd-4c0f-81be-223e0fa04e28 None admin] RBAC: Authorizing `identity:get_project(project_id=1cd2222d802944a886e177c05abb3640)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:04.081240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7745009-71cd-4c0f-81be-223e0fa04e28 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:04.088200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 84/172] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:03 2022] GET /identity/v3/projects/1cd2222d802944a886e177c05abb3640 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:04.089332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745009-71cd-4c0f-81be-223e0fa04e28 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:04.092719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10ede5-dfe3-4fb9-bc84-088647610db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:04.093764 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10ede5-dfe3-4fb9-bc84-088647610db0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:04.094225 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10ede5-dfe3-4fb9-bc84-088647610db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:04.094652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10ede5-dfe3-4fb9-bc84-088647610db0 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:04.095582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10ede5-dfe3-4fb9-bc84-088647610db0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:04.096053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10ede5-dfe3-4fb9-bc84-088647610db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:04.097762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10ede5-dfe3-4fb9-bc84-088647610db0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:04.107479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 89/173] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:04.108513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10ede5-dfe3-4fb9-bc84-088647610db0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:04.156669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:04.198093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745009-71cd-4c0f-81be-223e0fa04e28 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:04.224336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10ede5-dfe3-4fb9-bc84-088647610db0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:04.235846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0bf9-0795-45b8-b9af-575343bbb2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:04.236938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0bf9-0795-45b8-b9af-575343bbb2f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:04.237358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0bf9-0795-45b8-b9af-575343bbb2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:04.237777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0bf9-0795-45b8-b9af-575343bbb2f3 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/users/c87a5ab70ff346cfbec80c7f48cd7ff4/roles/8465efbb92344621a8ddda3834211a46` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:04.239979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f0bf9-0795-45b8-b9af-575343bbb2f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7c9534cee7f420a9b48f192ca318f6b, user_id=c87a5ab70ff346cfbec80c7f48cd7ff4, role_id=8465efbb92344621a8ddda3834211a46)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:04.241639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f0bf9-0795-45b8-b9af-575343bbb2f3 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:04.258602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 85/174] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:41:04 2022] PUT /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/users/c87a5ab70ff346cfbec80c7f48cd7ff4/roles/8465efbb92344621a8ddda3834211a46 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:04.260397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfd709-57ce-418f-b6da-19a52c0a8a64 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:04.260765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfd709-57ce-418f-b6da-19a52c0a8a64 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:04.261152 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfd709-57ce-418f-b6da-19a52c0a8a64 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:04.263177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 86/175] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:04.268225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfd709-57ce-418f-b6da-19a52c0a8a64 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:04.276493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d8b1-e8ae-4b0b-a5f8-65b40b51e5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:04.277572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d8b1-e8ae-4b0b-a5f8-65b40b51e5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:04.278128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d8b1-e8ae-4b0b-a5f8-65b40b51e5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:04.278634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d8b1-e8ae-4b0b-a5f8-65b40b51e5a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:04.279772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1d8b1-e8ae-4b0b-a5f8-65b40b51e5a8 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b, user.id=196de148ea764c458b8dc4b5fcb67ec4) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:04.280326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1d8b1-e8ae-4b0b-a5f8-65b40b51e5a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:04.282587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1d8b1-e8ae-4b0b-a5f8-65b40b51e5a8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:04.290823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 90/176] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:04 2022] GET /identity/v3/role_assignments?user.id=196de148ea764c458b8dc4b5fcb67ec4&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:04.292086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d8b1-e8ae-4b0b-a5f8-65b40b51e5a8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:04.341041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:04.415338 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d8b1-e8ae-4b0b-a5f8-65b40b51e5a8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:04.419168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:04.432081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfd709-57ce-418f-b6da-19a52c0a8a64 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:04.458119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af6e2b-fb47-421e-a405-919a800c4afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:04.459369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af6e2b-fb47-421e-a405-919a800c4afe None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:04.459816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af6e2b-fb47-421e-a405-919a800c4afe None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:04.460252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af6e2b-fb47-421e-a405-919a800c4afe None admin] PATH_INFO: `/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:04.462049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af6e2b-fb47-421e-a405-919a800c4afe None admin] RBAC: Authorizing `identity:get_user(user_id=1c0d1ccb3a22469bbe646d3ebef6e225)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:04.463975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af6e2b-fb47-421e-a405-919a800c4afe None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:04.466069 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 91/177] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:04 2022] GET /identity/v3/users/1c0d1ccb3a22469bbe646d3ebef6e225 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:04.467530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd4c5-5da2-4f9a-8784-ed83274c0c23 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:04.468034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd4c5-5da2-4f9a-8784-ed83274c0c23 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:04.469060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd4c5-5da2-4f9a-8784-ed83274c0c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:04.487182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878583ba-acba-4d81-815f-4ca556b37fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:04.488003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878583ba-acba-4d81-815f-4ca556b37fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:04.488195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fb6dd4c5-5da2-4f9a-8784-ed83274c0c23 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:04.488371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878583ba-acba-4d81-815f-4ca556b37fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:04.488756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878583ba-acba-4d81-815f-4ca556b37fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:04.489754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878583ba-acba-4d81-815f-4ca556b37fb7 None admin] RBAC: Adding query filter params (role.id=764ea3c1356843bca6a7e706c6ba9a20, scope.project.id=1cd2222d802944a886e177c05abb3640, user.id=1c0d1ccb3a22469bbe646d3ebef6e225) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:04.490186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878583ba-acba-4d81-815f-4ca556b37fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:04.490666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fb6dd4c5-5da2-4f9a-8784-ed83274c0c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:04.491870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878583ba-acba-4d81-815f-4ca556b37fb7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:04.498947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 87/178] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:04 2022] GET /identity/v3/role_assignments?user.id=1c0d1ccb3a22469bbe646d3ebef6e225&scope.project.id=1cd2222d802944a886e177c05abb3640&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:04.507002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878583ba-acba-4d81-815f-4ca556b37fb7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:04.606398 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 92/179] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:04.634671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dd4c5-5da2-4f9a-8784-ed83274c0c23 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:04.686840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878583ba-acba-4d81-815f-4ca556b37fb7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:04.711688 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:04.751362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a13d0-c66c-4b57-bcd3-77e3ee592c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:04.752040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a13d0-c66c-4b57-bcd3-77e3ee592c59 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:04.752321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a13d0-c66c-4b57-bcd3-77e3ee592c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:04.752597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a13d0-c66c-4b57-bcd3-77e3ee592c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:04.849040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dd4c5-5da2-4f9a-8784-ed83274c0c23 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:04.851625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:04.861864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a13d0-c66c-4b57-bcd3-77e3ee592c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:04.863595 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a13d0-c66c-4b57-bcd3-77e3ee592c59 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:04.897812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5d4c7-531e-4f74-ad9c-0a17459b036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:04.898880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5d4c7-531e-4f74-ad9c-0a17459b036f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:04.899276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5d4c7-531e-4f74-ad9c-0a17459b036f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:04.900090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5d4c7-531e-4f74-ad9c-0a17459b036f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:04.913197 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5d4c7-531e-4f74-ad9c-0a17459b036f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-97d5d4c7-531e-4f74-ad9c-0a17459b036f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:04.922934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:04.923992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:04.924884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:04.928147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 93/180] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:41:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:04.930610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c7f3-27ff-4983-8b90-28c634668efa None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:04.931220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c7f3-27ff-4983-8b90-28c634668efa None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:04.931814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c7f3-27ff-4983-8b90-28c634668efa None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:04.933800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 94/181] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:04.937092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93c7f3-27ff-4983-8b90-28c634668efa None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:05.032334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 88/182] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:05.034708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3644244-9834-4a57-a222-7dcde2a505c3 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:05.035136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3644244-9834-4a57-a222-7dcde2a505c3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:05.035538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3644244-9834-4a57-a222-7dcde2a505c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:05.056085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d3644244-9834-4a57-a222-7dcde2a505c3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:05.057606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d3644244-9834-4a57-a222-7dcde2a505c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:05.076065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:05.085289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93c7f3-27ff-4983-8b90-28c634668efa None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:05.124025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa14af4-53eb-4aec-9096-a5dd3f18e031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:05.125162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa14af4-53eb-4aec-9096-a5dd3f18e031 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:05.125633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa14af4-53eb-4aec-9096-a5dd3f18e031 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:05.125975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa14af4-53eb-4aec-9096-a5dd3f18e031 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:05.127261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa14af4-53eb-4aec-9096-a5dd3f18e031 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:05.127572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa14af4-53eb-4aec-9096-a5dd3f18e031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:05.129145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa14af4-53eb-4aec-9096-a5dd3f18e031 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:05.138597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 95/183] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:05.139134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa14af4-53eb-4aec-9096-a5dd3f18e031 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:05.141788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 89/184] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:05.143338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36965b89-b3eb-426c-ae8c-259a4898399a None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:05.143631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36965b89-b3eb-426c-ae8c-259a4898399a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:05.143907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36965b89-b3eb-426c-ae8c-259a4898399a None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:05.145214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 90/185] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:05.145991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36965b89-b3eb-426c-ae8c-259a4898399a None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:05.171186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:05.269354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa14af4-53eb-4aec-9096-a5dd3f18e031 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:05.274237 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36965b89-b3eb-426c-ae8c-259a4898399a None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:05.306509 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bbfcd-8751-4807-bd84-d607e2940226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:05.307455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bbfcd-8751-4807-bd84-d607e2940226 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:05.307740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bbfcd-8751-4807-bd84-d607e2940226 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:05.308006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bbfcd-8751-4807-bd84-d607e2940226 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:05.309178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bbfcd-8751-4807-bd84-d607e2940226 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:05.310660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bbfcd-8751-4807-bd84-d607e2940226 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:05.311784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24360bc-131e-45d5-8f8a-3470206009d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:05.317991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 96/186] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:05 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:05.318132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24360bc-131e-45d5-8f8a-3470206009d6 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:05.318132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24360bc-131e-45d5-8f8a-3470206009d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:05.318132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24360bc-131e-45d5-8f8a-3470206009d6 None admin] PATH_INFO: `/v3/users/5b2f50dfe3124fcb80903562980a6da5` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:05.318365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc712f50-ec92-455a-9e7d-778458c3ef32 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:05.318365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc712f50-ec92-455a-9e7d-778458c3ef32 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:05.318365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc712f50-ec92-455a-9e7d-778458c3ef32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:05.333788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24360bc-131e-45d5-8f8a-3470206009d6 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2f50dfe3124fcb80903562980a6da5)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:05.335332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24360bc-131e-45d5-8f8a-3470206009d6 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:05.335439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fc712f50-ec92-455a-9e7d-778458c3ef32 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:05.336527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fc712f50-ec92-455a-9e7d-778458c3ef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:05.337247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 91/187] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:05 2022] GET /identity/v3/users/5b2f50dfe3124fcb80903562980a6da5 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:05.339142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24360bc-131e-45d5-8f8a-3470206009d6 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:05.352730 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:05.421950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 97/188] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:05.421950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc712f50-ec92-455a-9e7d-778458c3ef32 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:05.449589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:05.466981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24360bc-131e-45d5-8f8a-3470206009d6 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:05.505063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4567-e673-4d6e-aa7c-0583775fd5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:05.505869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4567-e673-4d6e-aa7c-0583775fd5ad None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:05.506267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4567-e673-4d6e-aa7c-0583775fd5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:05.506476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4567-e673-4d6e-aa7c-0583775fd5ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:05.507655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4567-e673-4d6e-aa7c-0583775fd5ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:05.509560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4567-e673-4d6e-aa7c-0583775fd5ad None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:05.516471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 92/189] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:05.516471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4567-e673-4d6e-aa7c-0583775fd5ad None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:05.541503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc712f50-ec92-455a-9e7d-778458c3ef32 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:05.580365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dec2b-3283-4517-a019-793ac0f4b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:05.581926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dec2b-3283-4517-a019-793ac0f4b18c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:05.581926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dec2b-3283-4517-a019-793ac0f4b18c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:05.581926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dec2b-3283-4517-a019-793ac0f4b18c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:05.582420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dec2b-3283-4517-a019-793ac0f4b18c None admin] RBAC: Adding query filter params (role.id=ec1f98086b0748cf9d484264d6d60fff, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b, user.id=1c0d1ccb3a22469bbe646d3ebef6e225) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:05.582730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dec2b-3283-4517-a019-793ac0f4b18c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:05.584183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dec2b-3283-4517-a019-793ac0f4b18c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:05.597916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 98/190] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:05 2022] GET /identity/v3/role_assignments?user.id=1c0d1ccb3a22469bbe646d3ebef6e225&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=ec1f98086b0748cf9d484264d6d60fff => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:05.597916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dec2b-3283-4517-a019-793ac0f4b18c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:05.613650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:05.643324 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4567-e673-4d6e-aa7c-0583775fd5ad None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:05.697451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b916a6-30e4-4f27-bf06-839f9aad6814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:05.698107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b916a6-30e4-4f27-bf06-839f9aad6814 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:05.698358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b916a6-30e4-4f27-bf06-839f9aad6814 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:05.698638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b916a6-30e4-4f27-bf06-839f9aad6814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:05.718848 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:05.740686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dec2b-3283-4517-a019-793ac0f4b18c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:05.788258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b916a6-30e4-4f27-bf06-839f9aad6814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:05.790138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b916a6-30e4-4f27-bf06-839f9aad6814 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:05.796204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f15d1-6135-41f0-9455-799436c3f6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:05.797196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f15d1-6135-41f0-9455-799436c3f6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:05.797530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f15d1-6135-41f0-9455-799436c3f6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:05.797761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f15d1-6135-41f0-9455-799436c3f6d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:05.816803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f15d1-6135-41f0-9455-799436c3f6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4c9f15d1-6135-41f0-9455-799436c3f6d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:05.825260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:05.826150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:05.826950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:05.829710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 99/191] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:41:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:05.831070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f15d1-6135-41f0-9455-799436c3f6d0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:05.912335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:05.940768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 93/192] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:05.941521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b916a6-30e4-4f27-bf06-839f9aad6814 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:05.959533 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f15d1-6135-41f0-9455-799436c3f6d0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:05.998387 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f896b-5bab-4c59-9705-2f7570e4218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:05.999170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f896b-5bab-4c59-9705-2f7570e4218e None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:05.999517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f896b-5bab-4c59-9705-2f7570e4218e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:06.000443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f896b-5bab-4c59-9705-2f7570e4218e None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:06.001309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f896b-5bab-4c59-9705-2f7570e4218e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:06.002869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f896b-5bab-4c59-9705-2f7570e4218e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:06.025921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 100/193] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:41:05 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:41:06.027039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f896b-5bab-4c59-9705-2f7570e4218e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:06.030012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:06.073284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b916a6-30e4-4f27-bf06-839f9aad6814 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:06.124973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a62948-1f6d-430a-a761-648965aa8a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:06.127958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a62948-1f6d-430a-a761-648965aa8a15 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:06.128352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a62948-1f6d-430a-a761-648965aa8a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:06.128708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a62948-1f6d-430a-a761-648965aa8a15 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:06.129574 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a62948-1f6d-430a-a761-648965aa8a15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:06.129985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a62948-1f6d-430a-a761-648965aa8a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:06.131526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a62948-1f6d-430a-a761-648965aa8a15 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:06.144088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 94/194] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:06.150553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a62948-1f6d-430a-a761-648965aa8a15 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:06.172724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f896b-5bab-4c59-9705-2f7570e4218e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:06.206708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:06.224721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ee52a-a40f-418b-bb84-568f2d20a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:06.225521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ee52a-a40f-418b-bb84-568f2d20a29a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:06.225807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ee52a-a40f-418b-bb84-568f2d20a29a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:06.226361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ee52a-a40f-418b-bb84-568f2d20a29a None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:06.227403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ee52a-a40f-418b-bb84-568f2d20a29a None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:06.228851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ee52a-a40f-418b-bb84-568f2d20a29a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:06.230782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 101/195] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:06 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:06.236716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ee52a-a40f-418b-bb84-568f2d20a29a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:06.277583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a62948-1f6d-430a-a761-648965aa8a15 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:06.324362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dee56-9bbc-4130-b7e6-03abf74fecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:06.325256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dee56-9bbc-4130-b7e6-03abf74fecfe None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:06.325530 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dee56-9bbc-4130-b7e6-03abf74fecfe None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:06.325798 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dee56-9bbc-4130-b7e6-03abf74fecfe None admin] PATH_INFO: `/v3/users/5b2f50dfe3124fcb80903562980a6da5` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:06.327139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dee56-9bbc-4130-b7e6-03abf74fecfe None admin] RBAC: Authorizing `identity:get_user(user_id=5b2f50dfe3124fcb80903562980a6da5)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:06.329374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dee56-9bbc-4130-b7e6-03abf74fecfe None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:06.331966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 95/196] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:06 2022] GET /identity/v3/users/5b2f50dfe3124fcb80903562980a6da5 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:06.337876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dee56-9bbc-4130-b7e6-03abf74fecfe None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:06.345413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:06.392698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ee52a-a40f-418b-bb84-568f2d20a29a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:06.440702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f14bc-cad8-4dc8-ab7f-eaa3091cae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:06.441865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f14bc-cad8-4dc8-ab7f-eaa3091cae7f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:06.442321 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f14bc-cad8-4dc8-ab7f-eaa3091cae7f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:06.442672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f14bc-cad8-4dc8-ab7f-eaa3091cae7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:06.443634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f14bc-cad8-4dc8-ab7f-eaa3091cae7f None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0, user.id=5b2f50dfe3124fcb80903562980a6da5) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:06.444019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f14bc-cad8-4dc8-ab7f-eaa3091cae7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:06.445746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f14bc-cad8-4dc8-ab7f-eaa3091cae7f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:06.452581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 102/197] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:06 2022] GET /identity/v3/role_assignments?user.id=5b2f50dfe3124fcb80903562980a6da5&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:06.477351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dee56-9bbc-4130-b7e6-03abf74fecfe None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:06.487048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:06.519747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe39e9f-2a1e-4231-a6d6-9d7d388c6e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:06.520434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe39e9f-2a1e-4231-a6d6-9d7d388c6e0d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:06.520714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe39e9f-2a1e-4231-a6d6-9d7d388c6e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:06.520986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe39e9f-2a1e-4231-a6d6-9d7d388c6e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:06.601150 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe39e9f-2a1e-4231-a6d6-9d7d388c6e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:06.602718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe39e9f-2a1e-4231-a6d6-9d7d388c6e0d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:06.713958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 96/198] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:06.721182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f14bc-cad8-4dc8-ab7f-eaa3091cae7f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:06.862391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f14bc-cad8-4dc8-ab7f-eaa3091cae7f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:06.918403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e66c9-a215-4bbf-a404-928f41a58098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:06.919378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e66c9-a215-4bbf-a404-928f41a58098 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:06.919677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e66c9-a215-4bbf-a404-928f41a58098 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:06.919964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e66c9-a215-4bbf-a404-928f41a58098 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:06.921420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e66c9-a215-4bbf-a404-928f41a58098 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:06.923439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e66c9-a215-4bbf-a404-928f41a58098 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:06.925470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 103/199] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:06 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:06.934999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe39e9f-2a1e-4231-a6d6-9d7d388c6e0d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:06.944155 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2716ed-1809-45e1-b057-44c212a8519f None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:06.944461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2716ed-1809-45e1-b057-44c212a8519f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:06.944663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:06.944763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2716ed-1809-45e1-b057-44c212a8519f None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:06.947070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 104/200] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:41:06.952648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba342-75da-43a1-9d71-cf0b076c8ce0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:06.953079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba342-75da-43a1-9d71-cf0b076c8ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:06.953307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba342-75da-43a1-9d71-cf0b076c8ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:06.961321 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:06.986965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1ecba342-75da-43a1-9d71-cf0b076c8ce0 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:06.988182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1ecba342-75da-43a1-9d71-cf0b076c8ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:07.101694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe39e9f-2a1e-4231-a6d6-9d7d388c6e0d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:07.119387 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 105/201] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:07.169392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e79294-eb90-40b6-8791-293059045a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:07.170128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e79294-eb90-40b6-8791-293059045a50 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:07.170415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e79294-eb90-40b6-8791-293059045a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:07.170696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e79294-eb90-40b6-8791-293059045a50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:07.172078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e79294-eb90-40b6-8791-293059045a50 None admin] RBAC: Adding query filter params (role.id=ec1f98086b0748cf9d484264d6d60fff, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0, user.id=5b2f50dfe3124fcb80903562980a6da5) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:07.172398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e79294-eb90-40b6-8791-293059045a50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:07.173859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e79294-eb90-40b6-8791-293059045a50 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:07.179947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 97/202] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:06 2022] GET /identity/v3/role_assignments?user.id=5b2f50dfe3124fcb80903562980a6da5&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=ec1f98086b0748cf9d484264d6d60fff => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:07.182540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecba342-75da-43a1-9d71-cf0b076c8ce0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:07.361159 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecba342-75da-43a1-9d71-cf0b076c8ce0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:07.410976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:07.416894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffccd0-87e9-4848-bf87-d55220e3cd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:07.417763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffccd0-87e9-4848-bf87-d55220e3cd97 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:07.418072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffccd0-87e9-4848-bf87-d55220e3cd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:07.418348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffccd0-87e9-4848-bf87-d55220e3cd97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:07.439553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffccd0-87e9-4848-bf87-d55220e3cd97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-c5ffccd0-87e9-4848-bf87-d55220e3cd97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:07.447704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:07.448651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:07.449444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 106/203] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:07.455192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e79294-eb90-40b6-8791-293059045a50 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:07.578419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:07.617507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e79294-eb90-40b6-8791-293059045a50 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:07.685403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47c75b-ff4d-4be6-aa72-d48477bba14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:07.686136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47c75b-ff4d-4be6-aa72-d48477bba14e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:07.686419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47c75b-ff4d-4be6-aa72-d48477bba14e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:07.686693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47c75b-ff4d-4be6-aa72-d48477bba14e None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:07.688256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47c75b-ff4d-4be6-aa72-d48477bba14e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:07.688636 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47c75b-ff4d-4be6-aa72-d48477bba14e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:07.690059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47c75b-ff4d-4be6-aa72-d48477bba14e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:07.702050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 98/204] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:07.708643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffccd0-87e9-4848-bf87-d55220e3cd97 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:07.880719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffccd0-87e9-4848-bf87-d55220e3cd97 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:07.942913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6913eb-a99a-40d0-9bd1-7f960605396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:07.943727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6913eb-a99a-40d0-9bd1-7f960605396b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:07.944004 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6913eb-a99a-40d0-9bd1-7f960605396b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:07.944275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6913eb-a99a-40d0-9bd1-7f960605396b None admin] PATH_INFO: `/v3/users/c87a5ab70ff346cfbec80c7f48cd7ff4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:07.945632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6913eb-a99a-40d0-9bd1-7f960605396b None admin] RBAC: Authorizing `identity:get_user(user_id=c87a5ab70ff346cfbec80c7f48cd7ff4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:07.947132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6913eb-a99a-40d0-9bd1-7f960605396b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:07.948791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 107/205] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:07 2022] GET /identity/v3/users/c87a5ab70ff346cfbec80c7f48cd7ff4 => generated 289 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:07.954929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47c75b-ff4d-4be6-aa72-d48477bba14e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:08.127414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47c75b-ff4d-4be6-aa72-d48477bba14e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:08.178501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:08.183587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16660f70-b2b6-41f4-a9ea-a7fe7fe42bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:08.184364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16660f70-b2b6-41f4-a9ea-a7fe7fe42bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:08.184910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16660f70-b2b6-41f4-a9ea-a7fe7fe42bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:08.186618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16660f70-b2b6-41f4-a9ea-a7fe7fe42bc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:08.281934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16660f70-b2b6-41f4-a9ea-a7fe7fe42bc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:08.283426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16660f70-b2b6-41f4-a9ea-a7fe7fe42bc2 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:08.412874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 99/206] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:08.418386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6913eb-a99a-40d0-9bd1-7f960605396b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:08.491848 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:08.534316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6913eb-a99a-40d0-9bd1-7f960605396b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:08.569193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aee605-2761-48d9-9357-fec8878701c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:08.570143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee605-2761-48d9-9357-fec8878701c0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:08.570424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee605-2761-48d9-9357-fec8878701c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:08.570699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee605-2761-48d9-9357-fec8878701c0 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:08.571900 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aee605-2761-48d9-9357-fec8878701c0 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:08.573350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aee605-2761-48d9-9357-fec8878701c0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:08.575266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 108/207] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:08 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:08.582709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16660f70-b2b6-41f4-a9ea-a7fe7fe42bc2 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:08.622588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:08.729426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16660f70-b2b6-41f4-a9ea-a7fe7fe42bc2 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:08.746921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7864744-001c-4e5d-a803-371a4f6cdbed None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:08.747214 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7864744-001c-4e5d-a803-371a4f6cdbed None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:08.747491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7864744-001c-4e5d-a803-371a4f6cdbed None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:08.749012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 109/208] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:08.754393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded8d52-56a0-45cc-9fc0-b020a0ad0c8a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:08.754683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded8d52-56a0-45cc-9fc0-b020a0ad0c8a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:08.754967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded8d52-56a0-45cc-9fc0-b020a0ad0c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:08.773251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cded8d52-56a0-45cc-9fc0-b020a0ad0c8a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:08.778653 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cded8d52-56a0-45cc-9fc0-b020a0ad0c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:08.786610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7a858-a530-4b29-91c6-9b1d4e9f886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:08.787223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a858-a530-4b29-91c6-9b1d4e9f886d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:08.787505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a858-a530-4b29-91c6-9b1d4e9f886d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:08.787778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a858-a530-4b29-91c6-9b1d4e9f886d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:08.788612 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7a858-a530-4b29-91c6-9b1d4e9f886d None admin] RBAC: Adding query filter params (role.id=8465efbb92344621a8ddda3834211a46, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b, user.id=c87a5ab70ff346cfbec80c7f48cd7ff4) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:08.788926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7a858-a530-4b29-91c6-9b1d4e9f886d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:08.790392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7a858-a530-4b29-91c6-9b1d4e9f886d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:08.799300 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 100/209] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:08 2022] GET /identity/v3/role_assignments?user.id=c87a5ab70ff346cfbec80c7f48cd7ff4&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=8465efbb92344621a8ddda3834211a46 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:08.926852 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 110/210] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:08.975584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7a858-a530-4b29-91c6-9b1d4e9f886d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:09.099194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:09.105335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7a858-a530-4b29-91c6-9b1d4e9f886d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:09.146115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1a2ea-6b6a-4a20-a321-6342d4d58191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:09.146924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1a2ea-6b6a-4a20-a321-6342d4d58191 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.147206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1a2ea-6b6a-4a20-a321-6342d4d58191 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.147482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1a2ea-6b6a-4a20-a321-6342d4d58191 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.159461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1a2ea-6b6a-4a20-a321-6342d4d58191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-11f1a2ea-6b6a-4a20-a321-6342d4d58191 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:09.167354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:09.168250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:09.169028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 101/211] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:09.174951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded8d52-56a0-45cc-9fc0-b020a0ad0c8a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:09.186725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8173b-4e47-4a15-ad4b-a6add7a681c4 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.187539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8173b-4e47-4a15-ad4b-a6add7a681c4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.187826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8173b-4e47-4a15-ad4b-a6add7a681c4 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.189512 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 102/212] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:09.194518 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469d074-819a-40f9-875a-f64006f7a63f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.194983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469d074-819a-40f9-875a-f64006f7a63f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.195401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469d074-819a-40f9-875a-f64006f7a63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.212989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-1469d074-819a-40f9-875a-f64006f7a63f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:09.214471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1469d074-819a-40f9-875a-f64006f7a63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:09.275960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:09.312583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 103/213] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:09.333570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded8d52-56a0-45cc-9fc0-b020a0ad0c8a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:09.344578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469d074-819a-40f9-875a-f64006f7a63f None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:09.375497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f42b-555f-4dc4-9f51-5d432a52c1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:09.376282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f42b-555f-4dc4-9f51-5d432a52c1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.376563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f42b-555f-4dc4-9f51-5d432a52c1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.376835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f42b-555f-4dc4-9f51-5d432a52c1e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.377855 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145f42b-555f-4dc4-9f51-5d432a52c1e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:09.378189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145f42b-555f-4dc4-9f51-5d432a52c1e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:09.380320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145f42b-555f-4dc4-9f51-5d432a52c1e6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:09.396130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 111/214] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:09.398153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f42b-555f-4dc4-9f51-5d432a52c1e6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:09.441830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:09.459522 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469d074-819a-40f9-875a-f64006f7a63f None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:09.497854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1c415-6a33-4fa4-bd78-c14c1da978b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:09.498890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1c415-6a33-4fa4-bd78-c14c1da978b9 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.499292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1c415-6a33-4fa4-bd78-c14c1da978b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.499788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1c415-6a33-4fa4-bd78-c14c1da978b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.501230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1c415-6a33-4fa4-bd78-c14c1da978b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:09.502982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1c415-6a33-4fa4-bd78-c14c1da978b9 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:09.505150 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 104/215] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:09.513907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1c415-6a33-4fa4-bd78-c14c1da978b9 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:09.515059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f42b-555f-4dc4-9f51-5d432a52c1e6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:09.539114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:09.557129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27727246-3f36-47d0-97ee-39180de34a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:09.558259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27727246-3f36-47d0-97ee-39180de34a45 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.558690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27727246-3f36-47d0-97ee-39180de34a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.559067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27727246-3f36-47d0-97ee-39180de34a45 None admin] PATH_INFO: `/v3/users/1f50d317dc8642a28f38198449b41893` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.575546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27727246-3f36-47d0-97ee-39180de34a45 None admin] RBAC: Authorizing `identity:get_user(user_id=1f50d317dc8642a28f38198449b41893)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:09.577314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27727246-3f36-47d0-97ee-39180de34a45 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:09.579899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 112/216] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:09 2022] GET /identity/v3/users/1f50d317dc8642a28f38198449b41893 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:09.586404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27727246-3f36-47d0-97ee-39180de34a45 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:09.649118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1c415-6a33-4fa4-bd78-c14c1da978b9 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:09.683935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf98180-5464-41a0-88eb-5dca159002e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:09.684690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf98180-5464-41a0-88eb-5dca159002e2 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.684997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf98180-5464-41a0-88eb-5dca159002e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.685274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf98180-5464-41a0-88eb-5dca159002e2 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.686015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf98180-5464-41a0-88eb-5dca159002e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:09.687991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf98180-5464-41a0-88eb-5dca159002e2 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:09.694279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27727246-3f36-47d0-97ee-39180de34a45 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:09.708052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 105/217] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:41:09 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:41:09.716357 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746dc6-2dcb-4998-be1a-434b4ef3232c None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.716680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746dc6-2dcb-4998-be1a-434b4ef3232c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.717115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746dc6-2dcb-4998-be1a-434b4ef3232c None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.722209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 106/218] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:09.723677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0043-2c7f-46a9-883e-093fbb8bb600 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.723900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0043-2c7f-46a9-883e-093fbb8bb600 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.724171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0043-2c7f-46a9-883e-093fbb8bb600 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.725591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 107/219] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:09.731122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b01d0-876c-48bc-94e5-3013ac5afcad None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.731429 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b01d0-876c-48bc-94e5-3013ac5afcad None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.731692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b01d0-876c-48bc-94e5-3013ac5afcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.739456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab021bff-83e7-4755-8042-e546bb1a8ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:09.740138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021bff-83e7-4755-8042-e546bb1a8ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.740421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021bff-83e7-4755-8042-e546bb1a8ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.740698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021bff-83e7-4755-8042-e546bb1a8ff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.749365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-0c2b01d0-876c-48bc-94e5-3013ac5afcad None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:09.751480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0c2b01d0-876c-48bc-94e5-3013ac5afcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:09.755470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:09.795895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:09.825121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab021bff-83e7-4755-8042-e546bb1a8ff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:09.826679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab021bff-83e7-4755-8042-e546bb1a8ff5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:09.854072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 108/220] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:09.854072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042354-02a9-45f9-a4fc-608ba1e3e03f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:09.854072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042354-02a9-45f9-a4fc-608ba1e3e03f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:09.854072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042354-02a9-45f9-a4fc-608ba1e3e03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:09.874299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-9f042354-02a9-45f9-a4fc-608ba1e3e03f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:09.876063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9f042354-02a9-45f9-a4fc-608ba1e3e03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:09.947553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 113/221] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:09.948072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab021bff-83e7-4755-8042-e546bb1a8ff5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:09.965659 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 109/222] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:09.970788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f042354-02a9-45f9-a4fc-608ba1e3e03f None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:10.050250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:10.064095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:10.076514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab021bff-83e7-4755-8042-e546bb1a8ff5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:10.106824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f042354-02a9-45f9-a4fc-608ba1e3e03f None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:10.126137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0bc86-0575-4973-8d9f-37f5ee76fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:10.127444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0bc86-0575-4973-8d9f-37f5ee76fd5d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:10.128012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0bc86-0575-4973-8d9f-37f5ee76fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:10.128292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0bc86-0575-4973-8d9f-37f5ee76fd5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:10.144389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0bc86-0575-4973-8d9f-37f5ee76fd5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:10.150973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf040de-788c-4bc3-9566-532bc8263926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:10.151842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf040de-788c-4bc3-9566-532bc8263926 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:10.152120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf040de-788c-4bc3-9566-532bc8263926 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:10.152390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf040de-788c-4bc3-9566-532bc8263926 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-75f0bc86-0575-4973-8d9f-37f5ee76fd5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:10.153373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:10.154239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:10.155024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:10.155616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf040de-788c-4bc3-9566-532bc8263926 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:10.157299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 114/223] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:10.157485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf040de-788c-4bc3-9566-532bc8263926 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:10.157555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0bc86-0575-4973-8d9f-37f5ee76fd5d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:10.161907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 110/224] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:09 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:10.166901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf040de-788c-4bc3-9566-532bc8263926 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:10.294193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0bc86-0575-4973-8d9f-37f5ee76fd5d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:10.300245 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf040de-788c-4bc3-9566-532bc8263926 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:10.333685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bec74-1cdb-4bce-893e-35a1903b2f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:10.335461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bec74-1cdb-4bce-893e-35a1903b2f84 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:10.335947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bec74-1cdb-4bce-893e-35a1903b2f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:10.336458 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bec74-1cdb-4bce-893e-35a1903b2f84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:10.342051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b00e80-47ad-4065-bb7f-dbb41b9b5394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:10.342721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b00e80-47ad-4065-bb7f-dbb41b9b5394 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:10.343005 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b00e80-47ad-4065-bb7f-dbb41b9b5394 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:10.343385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b00e80-47ad-4065-bb7f-dbb41b9b5394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:10.344423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b00e80-47ad-4065-bb7f-dbb41b9b5394 None admin] RBAC: Adding query filter params (role.id=764ea3c1356843bca6a7e706c6ba9a20, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0, user.id=1f50d317dc8642a28f38198449b41893) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:10.344742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b00e80-47ad-4065-bb7f-dbb41b9b5394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:10.346290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b00e80-47ad-4065-bb7f-dbb41b9b5394 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:10.349380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:10.361917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 111/225] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:10 2022] GET /identity/v3/role_assignments?user.id=1f50d317dc8642a28f38198449b41893&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:10.361917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b00e80-47ad-4065-bb7f-dbb41b9b5394 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:10.361917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:10.364312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bec74-1cdb-4bce-893e-35a1903b2f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-db6bec74-1cdb-4bce-893e-35a1903b2f84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:10.372702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:10.373585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:10.374386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:10.383899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 115/226] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:41:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:10.390367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bec74-1cdb-4bce-893e-35a1903b2f84 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:10.484022 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b00e80-47ad-4065-bb7f-dbb41b9b5394 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:10.524388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70f427-84b9-492f-b720-2f91f64827d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:10.525189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70f427-84b9-492f-b720-2f91f64827d7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:10.525481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70f427-84b9-492f-b720-2f91f64827d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:10.525760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70f427-84b9-492f-b720-2f91f64827d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:10.526675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70f427-84b9-492f-b720-2f91f64827d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:10.526987 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70f427-84b9-492f-b720-2f91f64827d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:10.528575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70f427-84b9-492f-b720-2f91f64827d7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:10.559944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 112/227] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:10.566604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bec74-1cdb-4bce-893e-35a1903b2f84 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:10.568649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70f427-84b9-492f-b720-2f91f64827d7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:10.615719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673f590-2f24-4c01-80be-84db6ab4d0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:10.616463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673f590-2f24-4c01-80be-84db6ab4d0ca None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:10.616673 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673f590-2f24-4c01-80be-84db6ab4d0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:10.616951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673f590-2f24-4c01-80be-84db6ab4d0ca None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:10.617701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673f590-2f24-4c01-80be-84db6ab4d0ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:10.618039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673f590-2f24-4c01-80be-84db6ab4d0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:10.619471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673f590-2f24-4c01-80be-84db6ab4d0ca None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:10.644156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 116/228] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:10.654914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673f590-2f24-4c01-80be-84db6ab4d0ca None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:10.660506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:10.733159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70f427-84b9-492f-b720-2f91f64827d7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:10.806564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:10.821258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a3ee0-0447-48ff-bfde-3d4fd2d6bd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:10.825270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3ee0-0447-48ff-bfde-3d4fd2d6bd31 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:10.825557 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3ee0-0447-48ff-bfde-3d4fd2d6bd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:10.825839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3ee0-0447-48ff-bfde-3d4fd2d6bd31 None admin] PATH_INFO: `/v3/users/5b2f50dfe3124fcb80903562980a6da5` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:10.827370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a3ee0-0447-48ff-bfde-3d4fd2d6bd31 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2f50dfe3124fcb80903562980a6da5)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:10.829354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a3ee0-0447-48ff-bfde-3d4fd2d6bd31 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:10.831786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 113/229] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:10 2022] GET /identity/v3/users/5b2f50dfe3124fcb80903562980a6da5 => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:10.836761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a3ee0-0447-48ff-bfde-3d4fd2d6bd31 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:10.873316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673f590-2f24-4c01-80be-84db6ab4d0ca None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:10.910718 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd2cea-f9fb-4f6b-a50b-c5124862d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:10.911628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd2cea-f9fb-4f6b-a50b-c5124862d88e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:10.912056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd2cea-f9fb-4f6b-a50b-c5124862d88e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:10.912337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd2cea-f9fb-4f6b-a50b-c5124862d88e None admin] PATH_INFO: `/v3/users/5b2f50dfe3124fcb80903562980a6da5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:10.913581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd2cea-f9fb-4f6b-a50b-c5124862d88e None admin] RBAC: Authorizing `identity:get_user(user_id=5b2f50dfe3124fcb80903562980a6da5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:10.915160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd2cea-f9fb-4f6b-a50b-c5124862d88e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:10.917151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 117/230] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:10 2022] GET /identity/v3/users/5b2f50dfe3124fcb80903562980a6da5 => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:10.924231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd2cea-f9fb-4f6b-a50b-c5124862d88e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:11.028352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a3ee0-0447-48ff-bfde-3d4fd2d6bd31 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:11.039408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd2cea-f9fb-4f6b-a50b-c5124862d88e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:11.070019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:11.084867 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:11.085769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b60a46-4658-4594-87d2-07ef4310d158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:11.086757 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b60a46-4658-4594-87d2-07ef4310d158 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:11.087155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b60a46-4658-4594-87d2-07ef4310d158 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:11.087285 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b60a46-4658-4594-87d2-07ef4310d158 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:11.090596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b60a46-4658-4594-87d2-07ef4310d158 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:11.092286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b60a46-4658-4594-87d2-07ef4310d158 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:11.092694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e664-adc4-4098-8ba1-27298c2282bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:11.093638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e664-adc4-4098-8ba1-27298c2282bb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:11.094002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e664-adc4-4098-8ba1-27298c2282bb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:11.094292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e664-adc4-4098-8ba1-27298c2282bb None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:11.094695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 114/231] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:10 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:11.100313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b60a46-4658-4594-87d2-07ef4310d158 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:11.102702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e664-adc4-4098-8ba1-27298c2282bb None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:11.104178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e664-adc4-4098-8ba1-27298c2282bb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:11.119372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 118/232] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:10 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:11.120294 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e664-adc4-4098-8ba1-27298c2282bb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:11.242066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b60a46-4658-4594-87d2-07ef4310d158 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:11.278103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2c3aa-d7de-4c9b-a407-94e6479adaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:11.279014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c3aa-d7de-4c9b-a407-94e6479adaff None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:11.279297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c3aa-d7de-4c9b-a407-94e6479adaff None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:11.279573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c3aa-d7de-4c9b-a407-94e6479adaff None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/users/5b2f50dfe3124fcb80903562980a6da5/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:11.282650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2c3aa-d7de-4c9b-a407-94e6479adaff None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdc2b03f47c482d8d86dbba1db20be0, user_id=5b2f50dfe3124fcb80903562980a6da5, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:11.284128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2c3aa-d7de-4c9b-a407-94e6479adaff None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:11.300347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 115/233] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:41:11 2022] PUT /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/users/5b2f50dfe3124fcb80903562980a6da5/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:11.361412 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e664-adc4-4098-8ba1-27298c2282bb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:11.415638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f8944-b5b8-4d9c-ae56-e26a44fc5d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:11.416535 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f8944-b5b8-4d9c-ae56-e26a44fc5d0c None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:11.416812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f8944-b5b8-4d9c-ae56-e26a44fc5d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:11.417086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f8944-b5b8-4d9c-ae56-e26a44fc5d0c None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/users/5b2f50dfe3124fcb80903562980a6da5/roles/ec1f98086b0748cf9d484264d6d60fff` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:11.419357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f8944-b5b8-4d9c-ae56-e26a44fc5d0c None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdc2b03f47c482d8d86dbba1db20be0, user_id=5b2f50dfe3124fcb80903562980a6da5, role_id=ec1f98086b0748cf9d484264d6d60fff)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:11.420867 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f8944-b5b8-4d9c-ae56-e26a44fc5d0c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:11.439191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 119/234] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:41:11 2022] PUT /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/users/5b2f50dfe3124fcb80903562980a6da5/roles/ec1f98086b0748cf9d484264d6d60fff => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:12.395792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221afd2d-1952-4c63-aa48-4c3374e8afd8 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:12.396306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221afd2d-1952-4c63-aa48-4c3374e8afd8 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:12.396380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221afd2d-1952-4c63-aa48-4c3374e8afd8 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:12.397731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 116/235] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:12.399367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7850ff-6a5b-4e6c-be47-85447921167d None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:12.399768 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7850ff-6a5b-4e6c-be47-85447921167d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:12.399944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7850ff-6a5b-4e6c-be47-85447921167d None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:12.401463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 120/236] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:12.408924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f4a9c-17c6-4c32-9f1a-c0d02ca8fce2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:12.409202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f4a9c-17c6-4c32-9f1a-c0d02ca8fce2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:12.409481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f4a9c-17c6-4c32-9f1a-c0d02ca8fce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:12.409752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6247c8-6cee-4247-99d1-fc1924e1eea4 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:12.410063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6247c8-6cee-4247-99d1-fc1924e1eea4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:12.410337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6247c8-6cee-4247-99d1-fc1924e1eea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:12.439743 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b70f4a9c-17c6-4c32-9f1a-c0d02ca8fce2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:12.441001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b70f4a9c-17c6-4c32-9f1a-c0d02ca8fce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:12.445784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-7c6247c8-6cee-4247-99d1-fc1924e1eea4 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:12.447064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7c6247c8-6cee-4247-99d1-fc1924e1eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:12.543307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:12.552547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:12.575994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 117/237] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:12.583992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 121/238] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:12.601663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6247c8-6cee-4247-99d1-fc1924e1eea4 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:12.634302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f4a9c-17c6-4c32-9f1a-c0d02ca8fce2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:12.773419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6247c8-6cee-4247-99d1-fc1924e1eea4 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:12.814283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac1ba-89ca-47a6-922b-a1e4c5fd5bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:12.815150 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac1ba-89ca-47a6-922b-a1e4c5fd5bbb None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:12.815444 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac1ba-89ca-47a6-922b-a1e4c5fd5bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:12.815729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac1ba-89ca-47a6-922b-a1e4c5fd5bbb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:12.831657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f4a9c-17c6-4c32-9f1a-c0d02ca8fce2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:12.842957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ac1ba-89ca-47a6-922b-a1e4c5fd5bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-170ac1ba-89ca-47a6-922b-a1e4c5fd5bbb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:12.857933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:12.859058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:12.860215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:12.866791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 118/239] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:12.873025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac1ba-89ca-47a6-922b-a1e4c5fd5bbb None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:12.886995 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded3c8-8ae4-4188-9fd5-a50a154e29e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:12.888090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded3c8-8ae4-4188-9fd5-a50a154e29e3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:12.888471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded3c8-8ae4-4188-9fd5-a50a154e29e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:12.888731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded3c8-8ae4-4188-9fd5-a50a154e29e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:12.890528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feded3c8-8ae4-4188-9fd5-a50a154e29e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:12.892215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feded3c8-8ae4-4188-9fd5-a50a154e29e3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:12.893861 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 122/240] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:12.902887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded3c8-8ae4-4188-9fd5-a50a154e29e3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:12.963835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:13.009964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:13.040677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac1ba-89ca-47a6-922b-a1e4c5fd5bbb None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:13.062584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded3c8-8ae4-4188-9fd5-a50a154e29e3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:13.095871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f0437-b29c-482d-a982-b9cf83f9880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:13.097164 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f0437-b29c-482d-a982-b9cf83f9880c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:13.098127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f0437-b29c-482d-a982-b9cf83f9880c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:13.098890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f0437-b29c-482d-a982-b9cf83f9880c None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:13.100099 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f0437-b29c-482d-a982-b9cf83f9880c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:13.101004 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f0437-b29c-482d-a982-b9cf83f9880c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:13.103042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f0437-b29c-482d-a982-b9cf83f9880c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:13.105340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5bf19-4221-4b37-9cbc-fbe927d867db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:13.106062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5bf19-4221-4b37-9cbc-fbe927d867db None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:13.106331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5bf19-4221-4b37-9cbc-fbe927d867db None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:13.106601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5bf19-4221-4b37-9cbc-fbe927d867db None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:13.107353 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5bf19-4221-4b37-9cbc-fbe927d867db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:13.109350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5bf19-4221-4b37-9cbc-fbe927d867db None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:13.119592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 119/241] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:13.119592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af06f9-d0c9-47c1-9910-5a2446e59f5a None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:13.119819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af06f9-d0c9-47c1-9910-5a2446e59f5a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:13.119886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af06f9-d0c9-47c1-9910-5a2446e59f5a None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:13.121304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 120/242] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:13.122647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af06f9-d0c9-47c1-9910-5a2446e59f5a None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:13.144429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 123/243] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:41:12 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:41:13.150491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b85b5-3d4a-4534-8cc6-84ab7cea75c1 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:13.151108 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b85b5-3d4a-4534-8cc6-84ab7cea75c1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:13.151688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b85b5-3d4a-4534-8cc6-84ab7cea75c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:13.191770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1c7b85b5-3d4a-4534-8cc6-84ab7cea75c1 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:13.194492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1c7b85b5-3d4a-4534-8cc6-84ab7cea75c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:13.353721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af06f9-d0c9-47c1-9910-5a2446e59f5a None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:13.377557 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:13.384519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 124/244] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:13.406448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b211825-94e9-43c6-9cef-0029cdd371cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:13.407204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b85b5-3d4a-4534-8cc6-84ab7cea75c1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:13.408655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b211825-94e9-43c6-9cef-0029cdd371cf None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:13.409446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b211825-94e9-43c6-9cef-0029cdd371cf None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:13.410968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b211825-94e9-43c6-9cef-0029cdd371cf None admin] PATH_INFO: `/v3/users/9878c9bbfa2246f3aa0359514b2b2ab9` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:13.438189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b211825-94e9-43c6-9cef-0029cdd371cf None admin] RBAC: Authorizing `identity:get_user(user_id=9878c9bbfa2246f3aa0359514b2b2ab9)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:13.440043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b211825-94e9-43c6-9cef-0029cdd371cf None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:13.446005 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 121/245] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:13 2022] GET /identity/v3/users/9878c9bbfa2246f3aa0359514b2b2ab9 => generated 297 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:13.447823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b211825-94e9-43c6-9cef-0029cdd371cf None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:13.462239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:13.547147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b85b5-3d4a-4534-8cc6-84ab7cea75c1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:13.583673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b211825-94e9-43c6-9cef-0029cdd371cf None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:13.585575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb382c8-c9ee-4b9b-8733-813695da8d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:13.586526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb382c8-c9ee-4b9b-8733-813695da8d22 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:13.586886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb382c8-c9ee-4b9b-8733-813695da8d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:13.587240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb382c8-c9ee-4b9b-8733-813695da8d22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:13.600476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb382c8-c9ee-4b9b-8733-813695da8d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-8fb382c8-c9ee-4b9b-8733-813695da8d22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:13.608787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:13.609998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:13.611424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:13.613249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 125/246] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:13.616534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb382c8-c9ee-4b9b-8733-813695da8d22 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:13.633181 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17ee5-8980-471e-8298-b6537627991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:13.634271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17ee5-8980-471e-8298-b6537627991c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:13.634773 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17ee5-8980-471e-8298-b6537627991c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:13.635246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17ee5-8980-471e-8298-b6537627991c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:13.682052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:13.714429 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc17ee5-8980-471e-8298-b6537627991c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:13.716294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc17ee5-8980-471e-8298-b6537627991c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:13.732612 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:13.739240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb382c8-c9ee-4b9b-8733-813695da8d22 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:13.779157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb65be6-721a-4989-aee7-e631ef84d1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:13.779895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb65be6-721a-4989-aee7-e631ef84d1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:13.780181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb65be6-721a-4989-aee7-e631ef84d1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:13.780459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb65be6-721a-4989-aee7-e631ef84d1a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:13.781298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb65be6-721a-4989-aee7-e631ef84d1a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:13.781855 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb65be6-721a-4989-aee7-e631ef84d1a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:13.783461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb65be6-721a-4989-aee7-e631ef84d1a4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:13.794066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 126/247] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:13.799535 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb65be6-721a-4989-aee7-e631ef84d1a4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:13.874052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 122/248] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:13.878794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17ee5-8980-471e-8298-b6537627991c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:13.980638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb65be6-721a-4989-aee7-e631ef84d1a4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:14.001734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:14.046800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d770ab-17a4-4ae3-a3d8-9078ec6984a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:14.048126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d770ab-17a4-4ae3-a3d8-9078ec6984a3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:14.048415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d770ab-17a4-4ae3-a3d8-9078ec6984a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:14.048697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d770ab-17a4-4ae3-a3d8-9078ec6984a3 None admin] PATH_INFO: `/v3/users/1f50d317dc8642a28f38198449b41893` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:14.050640 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d770ab-17a4-4ae3-a3d8-9078ec6984a3 None admin] RBAC: Authorizing `identity:get_user(user_id=1f50d317dc8642a28f38198449b41893)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:14.052392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d770ab-17a4-4ae3-a3d8-9078ec6984a3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:14.057920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 127/249] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:13 2022] GET /identity/v3/users/1f50d317dc8642a28f38198449b41893 => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:14.057920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b746b-4ebc-4dfd-8fd9-5782465b058d None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:14.057920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b746b-4ebc-4dfd-8fd9-5782465b058d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:14.057920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b746b-4ebc-4dfd-8fd9-5782465b058d None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:14.058242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 128/250] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:14.060783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17ee5-8980-471e-8298-b6537627991c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:14.066544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbeed1-0886-4b7e-9036-ee75e5f36f34 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:14.066834 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbeed1-0886-4b7e-9036-ee75e5f36f34 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:14.067138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbeed1-0886-4b7e-9036-ee75e5f36f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:14.091283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-71dbeed1-0886-4b7e-9036-ee75e5f36f34 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:14.093095 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-71dbeed1-0886-4b7e-9036-ee75e5f36f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:14.107831 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b8621-7aab-42d6-a91d-0884ec8423e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:14.108711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8621-7aab-42d6-a91d-0884ec8423e1 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:14.109050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8621-7aab-42d6-a91d-0884ec8423e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:14.109332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8621-7aab-42d6-a91d-0884ec8423e1 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:14.110599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b8621-7aab-42d6-a91d-0884ec8423e1 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:14.112077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b8621-7aab-42d6-a91d-0884ec8423e1 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:14.118430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 123/251] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:13 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:14.119162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b8621-7aab-42d6-a91d-0884ec8423e1 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:14.127095 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:14.179336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 129/252] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:14.180093 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbeed1-0886-4b7e-9036-ee75e5f36f34 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:14.297014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbeed1-0886-4b7e-9036-ee75e5f36f34 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:14.330333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b8621-7aab-42d6-a91d-0884ec8423e1 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:14.336432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d1e56-b5b5-4428-b6a4-75bc7c8d6c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:14.337124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d1e56-b5b5-4428-b6a4-75bc7c8d6c05 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:14.337406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d1e56-b5b5-4428-b6a4-75bc7c8d6c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:14.337683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d1e56-b5b5-4428-b6a4-75bc7c8d6c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:14.338586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d1e56-b5b5-4428-b6a4-75bc7c8d6c05 None admin] RBAC: Adding query filter params (role.id=8465efbb92344621a8ddda3834211a46, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0, user.id=9878c9bbfa2246f3aa0359514b2b2ab9) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:14.338905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d1e56-b5b5-4428-b6a4-75bc7c8d6c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:14.340423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d1e56-b5b5-4428-b6a4-75bc7c8d6c05 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:14.354061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 130/253] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:14 2022] GET /identity/v3/role_assignments?user.id=9878c9bbfa2246f3aa0359514b2b2ab9&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=8465efbb92344621a8ddda3834211a46 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:14.355155 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d1e56-b5b5-4428-b6a4-75bc7c8d6c05 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:14.401379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:14.416669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae76df-f96e-4f65-b690-1cd4924eb23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:14.417596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae76df-f96e-4f65-b690-1cd4924eb23d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:14.417877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae76df-f96e-4f65-b690-1cd4924eb23d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:14.418174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae76df-f96e-4f65-b690-1cd4924eb23d None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:14.422605 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae76df-f96e-4f65-b690-1cd4924eb23d None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:14.424122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae76df-f96e-4f65-b690-1cd4924eb23d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:14.426014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 124/254] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:14 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:14.427309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376efe6-1423-4d86-86f1-4bde2f7f5c15 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:14.427594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376efe6-1423-4d86-86f1-4bde2f7f5c15 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:14.427869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376efe6-1423-4d86-86f1-4bde2f7f5c15 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:14.429119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 125/255] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:14.434828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376efe6-1423-4d86-86f1-4bde2f7f5c15 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:14.451027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:14.547135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d1e56-b5b5-4428-b6a4-75bc7c8d6c05 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:14.605442 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cf540-90ec-4da9-8022-57d4ff87abd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:14.606694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cf540-90ec-4da9-8022-57d4ff87abd3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:14.607200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cf540-90ec-4da9-8022-57d4ff87abd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:14.607674 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cf540-90ec-4da9-8022-57d4ff87abd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:14.620273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cf540-90ec-4da9-8022-57d4ff87abd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:14.627588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376efe6-1423-4d86-86f1-4bde2f7f5c15 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-378cf540-90ec-4da9-8022-57d4ff87abd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:14.629580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:14.630469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:14.631263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:14.633674 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 131/256] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:41:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:14.635116 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f7ec-0ef9-4b40-a63c-98d11b26a9d5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:14.635606 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f7ec-0ef9-4b40-a63c-98d11b26a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:14.636157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f7ec-0ef9-4b40-a63c-98d11b26a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:14.669712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d3f8f7ec-0ef9-4b40-a63c-98d11b26a9d5 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:14.671164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d3f8f7ec-0ef9-4b40-a63c-98d11b26a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:14.707125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399da1-22d6-4b7f-8228-8a157db039d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:14.708358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399da1-22d6-4b7f-8228-8a157db039d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:14.708785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399da1-22d6-4b7f-8228-8a157db039d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:14.709212 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399da1-22d6-4b7f-8228-8a157db039d0 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/users/1f50d317dc8642a28f38198449b41893/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:14.712951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c399da1-22d6-4b7f-8228-8a157db039d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdc2b03f47c482d8d86dbba1db20be0, user_id=1f50d317dc8642a28f38198449b41893, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:14.717533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c399da1-22d6-4b7f-8228-8a157db039d0 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:14.738013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 126/257] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:41:14 2022] PUT /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/users/1f50d317dc8642a28f38198449b41893/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:14.739370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399da1-22d6-4b7f-8228-8a157db039d0 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:14.792609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 132/258] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:14.835564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8f7ec-0ef9-4b40-a63c-98d11b26a9d5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:14.850816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:14.867711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:14.919134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399da1-22d6-4b7f-8228-8a157db039d0 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:14.962238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2cf80-f842-4db6-874a-76047a034155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:14.962921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2cf80-f842-4db6-874a-76047a034155 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:14.963242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2cf80-f842-4db6-874a-76047a034155 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:14.963472 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2cf80-f842-4db6-874a-76047a034155 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:14.964226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2cf80-f842-4db6-874a-76047a034155 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:14.964535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2cf80-f842-4db6-874a-76047a034155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:14.965940 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2cf80-f842-4db6-874a-76047a034155 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:14.996274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 127/259] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:15.003029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2cf80-f842-4db6-874a-76047a034155 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:15.014875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8f7ec-0ef9-4b40-a63c-98d11b26a9d5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:15.056128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e336a3a-65ae-453d-ac8d-33a8550e8df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:15.057186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e336a3a-65ae-453d-ac8d-33a8550e8df7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:15.057615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e336a3a-65ae-453d-ac8d-33a8550e8df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:15.058175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e336a3a-65ae-453d-ac8d-33a8550e8df7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:15.071078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e336a3a-65ae-453d-ac8d-33a8550e8df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4e336a3a-65ae-453d-ac8d-33a8550e8df7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:15.080074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:15.080973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:15.081760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:15.084292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 133/260] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:41:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:15.090764 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e336a3a-65ae-453d-ac8d-33a8550e8df7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:15.174487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:15.193255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2cf80-f842-4db6-874a-76047a034155 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:15.202715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e336a3a-65ae-453d-ac8d-33a8550e8df7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:15.241331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c70883-0e99-4b5c-ac34-aa7358b113f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:15.242427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c70883-0e99-4b5c-ac34-aa7358b113f1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:15.243050 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c70883-0e99-4b5c-ac34-aa7358b113f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:15.243524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c70883-0e99-4b5c-ac34-aa7358b113f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:15.244476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c70883-0e99-4b5c-ac34-aa7358b113f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:15.244982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c70883-0e99-4b5c-ac34-aa7358b113f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:15.246701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c70883-0e99-4b5c-ac34-aa7358b113f1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:15.249361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:15.258705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 134/261] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:15.264778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c70883-0e99-4b5c-ac34-aa7358b113f1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:15.269355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044aa3b-d921-4cd9-8181-72bbe8fc3063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:15.270374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044aa3b-d921-4cd9-8181-72bbe8fc3063 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:15.270804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044aa3b-d921-4cd9-8181-72bbe8fc3063 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:15.271228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044aa3b-d921-4cd9-8181-72bbe8fc3063 None admin] PATH_INFO: `/v3/users/5b2f50dfe3124fcb80903562980a6da5` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:15.272620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044aa3b-d921-4cd9-8181-72bbe8fc3063 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2f50dfe3124fcb80903562980a6da5)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:15.274243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044aa3b-d921-4cd9-8181-72bbe8fc3063 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:15.276034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 128/262] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:15 2022] GET /identity/v3/users/5b2f50dfe3124fcb80903562980a6da5 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:15.286119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044aa3b-d921-4cd9-8181-72bbe8fc3063 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:15.422893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044aa3b-d921-4cd9-8181-72bbe8fc3063 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:15.442738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c70883-0e99-4b5c-ac34-aa7358b113f1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:15.507796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16aa2-8cea-4c46-9229-7fd848039441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:15.508819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16aa2-8cea-4c46-9229-7fd848039441 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:15.509267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16aa2-8cea-4c46-9229-7fd848039441 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:15.509680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16aa2-8cea-4c46-9229-7fd848039441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:15.518207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb9298-e3ad-44d6-9243-76e827f902e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:15.519235 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb9298-e3ad-44d6-9243-76e827f902e8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:15.519641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb9298-e3ad-44d6-9243-76e827f902e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:15.520017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb9298-e3ad-44d6-9243-76e827f902e8 None admin] PATH_INFO: `/v3/users/5b2f50dfe3124fcb80903562980a6da5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:15.521413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb9298-e3ad-44d6-9243-76e827f902e8 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2f50dfe3124fcb80903562980a6da5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:15.525909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb9298-e3ad-44d6-9243-76e827f902e8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:15.525909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 135/263] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:15 2022] GET /identity/v3/users/5b2f50dfe3124fcb80903562980a6da5 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:15.530232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb9298-e3ad-44d6-9243-76e827f902e8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:15.542220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:15.636410 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:15.654752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba16aa2-8cea-4c46-9229-7fd848039441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:15.656859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba16aa2-8cea-4c46-9229-7fd848039441 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:15.739476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb9298-e3ad-44d6-9243-76e827f902e8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:15.806631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413cd0d-8204-4962-805d-629d97f4b34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:15.807324 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413cd0d-8204-4962-805d-629d97f4b34a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:15.807684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413cd0d-8204-4962-805d-629d97f4b34a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:15.807882 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413cd0d-8204-4962-805d-629d97f4b34a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:15.865073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 129/264] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:41:15.875123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16aa2-8cea-4c46-9229-7fd848039441 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:15.961273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413cd0d-8204-4962-805d-629d97f4b34a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:15.962919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413cd0d-8204-4962-805d-629d97f4b34a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:15.969505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:16.105952 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:16.120372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16aa2-8cea-4c46-9229-7fd848039441 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:16.174073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 136/265] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:16.180664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413cd0d-8204-4962-805d-629d97f4b34a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:16.214088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509903c0-3e23-410b-985a-bfd0b7fe072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:16.214988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509903c0-3e23-410b-985a-bfd0b7fe072e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:16.215267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509903c0-3e23-410b-985a-bfd0b7fe072e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:16.215541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509903c0-3e23-410b-985a-bfd0b7fe072e None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:16.216764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509903c0-3e23-410b-985a-bfd0b7fe072e None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:16.218538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509903c0-3e23-410b-985a-bfd0b7fe072e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:16.226362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 130/266] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:15 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:16.232186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509903c0-3e23-410b-985a-bfd0b7fe072e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:16.344359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413cd0d-8204-4962-805d-629d97f4b34a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:16.347609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:16.409688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc28e0-edd8-4162-afa5-e3160cd91a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:16.410485 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc28e0-edd8-4162-afa5-e3160cd91a04 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:16.410772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc28e0-edd8-4162-afa5-e3160cd91a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:16.411067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc28e0-edd8-4162-afa5-e3160cd91a04 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:16.414931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509903c0-3e23-410b-985a-bfd0b7fe072e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:16.418717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc28e0-edd8-4162-afa5-e3160cd91a04 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:16.420189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc28e0-edd8-4162-afa5-e3160cd91a04 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:16.422089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 137/267] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:16 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:16.428770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc28e0-edd8-4162-afa5-e3160cd91a04 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:16.456961 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e9f9e-11d1-4311-83df-17b895529725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:16.457631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e9f9e-11d1-4311-83df-17b895529725 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:16.457927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e9f9e-11d1-4311-83df-17b895529725 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:16.458210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e9f9e-11d1-4311-83df-17b895529725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:16.459037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e9f9e-11d1-4311-83df-17b895529725 None admin] RBAC: Adding query filter params (role.id=ec1f98086b0748cf9d484264d6d60fff, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0, user.id=5b2f50dfe3124fcb80903562980a6da5) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:16.459354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e9f9e-11d1-4311-83df-17b895529725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:16.460796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e9f9e-11d1-4311-83df-17b895529725 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:16.467102 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 131/268] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:16 2022] GET /identity/v3/role_assignments?user.id=5b2f50dfe3124fcb80903562980a6da5&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=ec1f98086b0748cf9d484264d6d60fff => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:16.636302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc28e0-edd8-4162-afa5-e3160cd91a04 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:16.676565 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b1544-b92f-438d-a0ca-902ab557d5a3 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:16.677215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b1544-b92f-438d-a0ca-902ab557d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:16.677724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b1544-b92f-438d-a0ca-902ab557d5a3 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:16.680209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 132/269] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:16.686671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6880d5-fa7c-4adb-85d3-20cd6c665954 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:16.688038 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6880d5-fa7c-4adb-85d3-20cd6c665954 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:16.688631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6880d5-fa7c-4adb-85d3-20cd6c665954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:16.723799 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3b6880d5-fa7c-4adb-85d3-20cd6c665954 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:16.725385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3b6880d5-fa7c-4adb-85d3-20cd6c665954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:16.742646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7ef4-289c-40ab-8f47-53482b10042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:16.743954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7ef4-289c-40ab-8f47-53482b10042a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:16.744411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7ef4-289c-40ab-8f47-53482b10042a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:16.744836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7ef4-289c-40ab-8f47-53482b10042a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:16.745849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7ef4-289c-40ab-8f47-53482b10042a None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0, user.id=5b2f50dfe3124fcb80903562980a6da5) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:16.746347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7ef4-289c-40ab-8f47-53482b10042a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:16.748011 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7ef4-289c-40ab-8f47-53482b10042a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:16.759174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 138/270] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:16 2022] GET /identity/v3/role_assignments?user.id=5b2f50dfe3124fcb80903562980a6da5&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:16.766641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:16.840029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 133/271] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:16.867216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7ef4-289c-40ab-8f47-53482b10042a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:16.919182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:17.002367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7fe9b-042b-4618-98b2-071a8ecf2c0c None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.002692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7fe9b-042b-4618-98b2-071a8ecf2c0c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.002917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7fe9b-042b-4618-98b2-071a8ecf2c0c None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.004310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 134/272] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:41:17.010075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fde32-e098-47cf-8abc-2865db033b18 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.010354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fde32-e098-47cf-8abc-2865db033b18 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.010628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fde32-e098-47cf-8abc-2865db033b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.018720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7ef4-289c-40ab-8f47-53482b10042a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:17.032273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d34fde32-e098-47cf-8abc-2865db033b18 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:17.033681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d34fde32-e098-47cf-8abc-2865db033b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:17.071528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec0c9f-8a0b-4adc-ad59-58a539a35a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:17.072689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec0c9f-8a0b-4adc-ad59-58a539a35a94 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.073164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec0c9f-8a0b-4adc-ad59-58a539a35a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.074051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec0c9f-8a0b-4adc-ad59-58a539a35a94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.092514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec0c9f-8a0b-4adc-ad59-58a539a35a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-9dec0c9f-8a0b-4adc-ad59-58a539a35a94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:17.102645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:17.103587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:17.104378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 139/273] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:17.112044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec0c9f-8a0b-4adc-ad59-58a539a35a94 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:17.142391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 135/274] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:17.171971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fde32-e098-47cf-8abc-2865db033b18 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:17.239115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:17.246621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec0c9f-8a0b-4adc-ad59-58a539a35a94 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:17.292290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba185f-51b8-4752-a468-8f9dc4894b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:17.293496 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba185f-51b8-4752-a468-8f9dc4894b90 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.293979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba185f-51b8-4752-a468-8f9dc4894b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.294263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba185f-51b8-4752-a468-8f9dc4894b90 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.295332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba185f-51b8-4752-a468-8f9dc4894b90 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:17.295675 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba185f-51b8-4752-a468-8f9dc4894b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:17.298282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba185f-51b8-4752-a468-8f9dc4894b90 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:17.301565 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:17.311925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 140/275] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:17.316763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba185f-51b8-4752-a468-8f9dc4894b90 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:17.319060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fde32-e098-47cf-8abc-2865db033b18 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:17.362838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ce0cc-987a-4c2b-9cf7-a3a19f3b4967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:17.364032 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce0cc-987a-4c2b-9cf7-a3a19f3b4967 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.364916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce0cc-987a-4c2b-9cf7-a3a19f3b4967 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.365398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce0cc-987a-4c2b-9cf7-a3a19f3b4967 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.367177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ce0cc-987a-4c2b-9cf7-a3a19f3b4967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:17.369435 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ce0cc-987a-4c2b-9cf7-a3a19f3b4967 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:17.371884 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 136/276] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:17.380942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ce0cc-987a-4c2b-9cf7-a3a19f3b4967 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:17.443466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba185f-51b8-4752-a468-8f9dc4894b90 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:17.487047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb058f-7aa4-49f3-b3d3-3332b79e0b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:17.487793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ce0cc-987a-4c2b-9cf7-a3a19f3b4967 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:17.488277 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb058f-7aa4-49f3-b3d3-3332b79e0b94 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.488430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb058f-7aa4-49f3-b3d3-3332b79e0b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.488840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb058f-7aa4-49f3-b3d3-3332b79e0b94 None admin] PATH_INFO: `/v3/users/fff568f7ce574bf4b6cbaf1618dd61c4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.506830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb058f-7aa4-49f3-b3d3-3332b79e0b94 None admin] RBAC: Authorizing `identity:get_user(user_id=fff568f7ce574bf4b6cbaf1618dd61c4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:17.508987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb058f-7aa4-49f3-b3d3-3332b79e0b94 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:17.511021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 141/277] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:17 2022] GET /identity/v3/users/fff568f7ce574bf4b6cbaf1618dd61c4 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:17.517658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb058f-7aa4-49f3-b3d3-3332b79e0b94 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:17.536205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d773f-7839-46c9-93b7-a5791723b009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:17.537209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d773f-7839-46c9-93b7-a5791723b009 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.537631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d773f-7839-46c9-93b7-a5791723b009 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.538286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:17.539043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d773f-7839-46c9-93b7-a5791723b009 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.539944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d773f-7839-46c9-93b7-a5791723b009 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:17.542702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d773f-7839-46c9-93b7-a5791723b009 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:17.568873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 137/278] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:41:17 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:41:17.649758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb058f-7aa4-49f3-b3d3-3332b79e0b94 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:17.661026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb2bf5-e434-4aa2-ae89-105612ebe540 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.661546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb2bf5-e434-4aa2-ae89-105612ebe540 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.661979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb2bf5-e434-4aa2-ae89-105612ebe540 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.663551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 138/279] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:17.670032 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfae7-88d8-412d-b0d7-e04d1843d6c8 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.670689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfae7-88d8-412d-b0d7-e04d1843d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.671690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfae7-88d8-412d-b0d7-e04d1843d6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.691873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-9c5cfae7-88d8-412d-b0d7-e04d1843d6c8 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:17.693718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9c5cfae7-88d8-412d-b0d7-e04d1843d6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:17.694569 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddd2e2-4b12-4c48-bab0-8dc5a22ae568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:17.695239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddd2e2-4b12-4c48-bab0-8dc5a22ae568 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.695518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddd2e2-4b12-4c48-bab0-8dc5a22ae568 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.695791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddd2e2-4b12-4c48-bab0-8dc5a22ae568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.696630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddd2e2-4b12-4c48-bab0-8dc5a22ae568 None admin] RBAC: Adding query filter params (role.id=764ea3c1356843bca6a7e706c6ba9a20, user.id=fff568f7ce574bf4b6cbaf1618dd61c4, scope.system=all) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:17.696941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddd2e2-4b12-4c48-bab0-8dc5a22ae568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:17.698502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddd2e2-4b12-4c48-bab0-8dc5a22ae568 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:17.705044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 142/280] 10.222.0.81 () {56 vars in 1308 bytes} [Thu Jun 16 14:41:17 2022] GET /identity/v3/role_assignments?user.id=fff568f7ce574bf4b6cbaf1618dd61c4&scope.system=all&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:17.706036 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:17.784369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 139/281] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:17.809239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddd2e2-4b12-4c48-bab0-8dc5a22ae568 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:17.887685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac2e0-44ee-4cc4-89d4-adb00a329b5a None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.887995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac2e0-44ee-4cc4-89d4-adb00a329b5a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.888245 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac2e0-44ee-4cc4-89d4-adb00a329b5a None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.889806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 140/282] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:17.895854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab492-756e-4cc2-a38d-d8d28e494a7d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.896471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab492-756e-4cc2-a38d-d8d28e494a7d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.896963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab492-756e-4cc2-a38d-d8d28e494a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.908488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:17.918421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-338ab492-756e-4cc2-a38d-d8d28e494a7d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:17.919609 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-338ab492-756e-4cc2-a38d-d8d28e494a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:17.931328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddd2e2-4b12-4c48-bab0-8dc5a22ae568 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:17.971846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbfdf0-6181-4163-b147-bbc617f40d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:17.972890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbfdf0-6181-4163-b147-bbc617f40d3e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:17.973317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbfdf0-6181-4163-b147-bbc617f40d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:17.973748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbfdf0-6181-4163-b147-bbc617f40d3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:17.986274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbfdf0-6181-4163-b147-bbc617f40d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-40cbfdf0-6181-4163-b147-bbc617f40d3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:17.995748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:17.996643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:17.997426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 143/283] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:18.011847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbfdf0-6181-4163-b147-bbc617f40d3e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:18.020979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 141/284] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:18.058089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ab492-756e-4cc2-a38d-d8d28e494a7d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:18.128062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbfdf0-6181-4163-b147-bbc617f40d3e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:18.136293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:18.168157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dbaa6-642e-46c7-b24c-442250b9b68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:18.168786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ab492-756e-4cc2-a38d-d8d28e494a7d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:18.169440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dbaa6-642e-46c7-b24c-442250b9b68f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:18.169956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dbaa6-642e-46c7-b24c-442250b9b68f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:18.170483 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dbaa6-642e-46c7-b24c-442250b9b68f None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:18.171818 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dbaa6-642e-46c7-b24c-442250b9b68f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:18.172331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dbaa6-642e-46c7-b24c-442250b9b68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:18.173952 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dbaa6-642e-46c7-b24c-442250b9b68f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:18.183693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 144/285] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:18.189466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dbaa6-642e-46c7-b24c-442250b9b68f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:18.210449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:18.234943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6f140-1201-4d0b-80c1-63aec5ea69bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:18.235682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f140-1201-4d0b-80c1-63aec5ea69bd None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:18.235965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f140-1201-4d0b-80c1-63aec5ea69bd None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:18.236234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f140-1201-4d0b-80c1-63aec5ea69bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:18.268774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6f140-1201-4d0b-80c1-63aec5ea69bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-48a6f140-1201-4d0b-80c1-63aec5ea69bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:18.285306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:18.286305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:18.287082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 142/286] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:41:18.294929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6f140-1201-4d0b-80c1-63aec5ea69bd None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:18.330511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dbaa6-642e-46c7-b24c-442250b9b68f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:18.418915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa21ca-79bf-4023-a3cc-ccdecfd292e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:18.421020 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa21ca-79bf-4023-a3cc-ccdecfd292e7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:18.421849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa21ca-79bf-4023-a3cc-ccdecfd292e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:18.422278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa21ca-79bf-4023-a3cc-ccdecfd292e7 None admin] PATH_INFO: `/v3/users/9878c9bbfa2246f3aa0359514b2b2ab9` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:18.423827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa21ca-79bf-4023-a3cc-ccdecfd292e7 None admin] RBAC: Authorizing `identity:get_user(user_id=9878c9bbfa2246f3aa0359514b2b2ab9)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:18.426109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa21ca-79bf-4023-a3cc-ccdecfd292e7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:18.428713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 145/287] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:18 2022] GET /identity/v3/users/9878c9bbfa2246f3aa0359514b2b2ab9 => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:18.437288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa21ca-79bf-4023-a3cc-ccdecfd292e7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:18.460078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6f140-1201-4d0b-80c1-63aec5ea69bd None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:18.522270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:18.530376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decabf7b-dd90-4657-b552-ab8eff470481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:18.531234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decabf7b-dd90-4657-b552-ab8eff470481 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:18.531504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decabf7b-dd90-4657-b552-ab8eff470481 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:18.531796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decabf7b-dd90-4657-b552-ab8eff470481 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:18.532557 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decabf7b-dd90-4657-b552-ab8eff470481 None admin] RBAC: Adding query filter params (name=member) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:18.532871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decabf7b-dd90-4657-b552-ab8eff470481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:18.534328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decabf7b-dd90-4657-b552-ab8eff470481 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:18.557724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 143/288] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:18.560784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decabf7b-dd90-4657-b552-ab8eff470481 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:18.580893 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:18.627734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa21ca-79bf-4023-a3cc-ccdecfd292e7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:18.693536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e66ca-d76f-42e5-a03c-1d861e694f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:18.694887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e66ca-d76f-42e5-a03c-1d861e694f61 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:18.695313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e66ca-d76f-42e5-a03c-1d861e694f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:18.695721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e66ca-d76f-42e5-a03c-1d861e694f61 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:18.697058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e66ca-d76f-42e5-a03c-1d861e694f61 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:18.700504 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e66ca-d76f-42e5-a03c-1d861e694f61 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:18.703680 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 146/289] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:18 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:18.716439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e66ca-d76f-42e5-a03c-1d861e694f61 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:18.849507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decabf7b-dd90-4657-b552-ab8eff470481 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:18.888098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e66ca-d76f-42e5-a03c-1d861e694f61 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:18.919430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc02217-e9ac-421b-b56c-3ed49bae350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:18.920556 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc02217-e9ac-421b-b56c-3ed49bae350b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:18.920984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc02217-e9ac-421b-b56c-3ed49bae350b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:18.921490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc02217-e9ac-421b-b56c-3ed49bae350b None admin] PATH_INFO: `/v3/users/1f50d317dc8642a28f38198449b41893` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:18.924022 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc02217-e9ac-421b-b56c-3ed49bae350b None admin] RBAC: Authorizing `identity:get_user(user_id=1f50d317dc8642a28f38198449b41893)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:18.928800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc02217-e9ac-421b-b56c-3ed49bae350b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:18.930686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 144/290] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:18 2022] GET /identity/v3/users/1f50d317dc8642a28f38198449b41893 => generated 297 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:18.935988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc02217-e9ac-421b-b56c-3ed49bae350b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:18.956977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679aca47-a51a-4c74-83cb-aa43f2072b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:18.958281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679aca47-a51a-4c74-83cb-aa43f2072b89 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:18.960114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679aca47-a51a-4c74-83cb-aa43f2072b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:18.960597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679aca47-a51a-4c74-83cb-aa43f2072b89 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/users/9878c9bbfa2246f3aa0359514b2b2ab9/roles/8465efbb92344621a8ddda3834211a46` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:18.965162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679aca47-a51a-4c74-83cb-aa43f2072b89 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdc2b03f47c482d8d86dbba1db20be0, user_id=9878c9bbfa2246f3aa0359514b2b2ab9, role_id=8465efbb92344621a8ddda3834211a46)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:18.966922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679aca47-a51a-4c74-83cb-aa43f2072b89 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:18.986262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:18.995845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 147/291] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:41:18 2022] PUT /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/users/9878c9bbfa2246f3aa0359514b2b2ab9/roles/8465efbb92344621a8ddda3834211a46 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:19.100317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:19.202203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc02217-e9ac-421b-b56c-3ed49bae350b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:19.249268 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf05719-5398-4316-861d-ea834036d75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:19.250506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf05719-5398-4316-861d-ea834036d75c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:19.251015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf05719-5398-4316-861d-ea834036d75c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:19.251482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf05719-5398-4316-861d-ea834036d75c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:19.329534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf05719-5398-4316-861d-ea834036d75c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:19.331505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf05719-5398-4316-861d-ea834036d75c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:19.399559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:19.446021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 145/292] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:19.455965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679aca47-a51a-4c74-83cb-aa43f2072b89 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:19.641071 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679aca47-a51a-4c74-83cb-aa43f2072b89 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:19.709014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b93f7-f134-4624-8e1a-a86d2f5b7ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:19.709927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b93f7-f134-4624-8e1a-a86d2f5b7ddd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:19.710219 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b93f7-f134-4624-8e1a-a86d2f5b7ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:19.710499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b93f7-f134-4624-8e1a-a86d2f5b7ddd None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:19.714620 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b93f7-f134-4624-8e1a-a86d2f5b7ddd None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:19.716076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b93f7-f134-4624-8e1a-a86d2f5b7ddd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:19.718653 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 148/293] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:19 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:19.724487 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf05719-5398-4316-861d-ea834036d75c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:19.869536 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf05719-5398-4316-861d-ea834036d75c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:19.925151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2d8d8-07fd-47ac-bec1-0cc45e6bb4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:19.926073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2d8d8-07fd-47ac-bec1-0cc45e6bb4af None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:19.926545 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2d8d8-07fd-47ac-bec1-0cc45e6bb4af None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:19.926983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2d8d8-07fd-47ac-bec1-0cc45e6bb4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:19.927960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2d8d8-07fd-47ac-bec1-0cc45e6bb4af None admin] RBAC: Adding query filter params (role.id=764ea3c1356843bca6a7e706c6ba9a20, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0, user.id=1f50d317dc8642a28f38198449b41893) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:19.928420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2d8d8-07fd-47ac-bec1-0cc45e6bb4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:19.930114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2d8d8-07fd-47ac-bec1-0cc45e6bb4af None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:19.938802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 146/294] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:19 2022] GET /identity/v3/role_assignments?user.id=1f50d317dc8642a28f38198449b41893&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:20.134740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14ae6b-b73c-4f3c-9874-cdd218a11587 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:20.135249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14ae6b-b73c-4f3c-9874-cdd218a11587 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:20.135350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14ae6b-b73c-4f3c-9874-cdd218a11587 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:20.136956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 149/295] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:20.143907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666dbe2-ecc5-4c79-82b0-4074251ae001 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:20.144540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666dbe2-ecc5-4c79-82b0-4074251ae001 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:20.145017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666dbe2-ecc5-4c79-82b0-4074251ae001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:20.162880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d666dbe2-ecc5-4c79-82b0-4074251ae001 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:20.164433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d666dbe2-ecc5-4c79-82b0-4074251ae001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:20.187527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:20.242169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 147/296] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:20.267612 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14ae6b-b73c-4f3c-9874-cdd218a11587 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:20.340282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:20.386787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14ae6b-b73c-4f3c-9874-cdd218a11587 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:20.423666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1206d32-eb09-4223-a42f-bdcd8db8d74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:20.424527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1206d32-eb09-4223-a42f-bdcd8db8d74a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:20.424815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1206d32-eb09-4223-a42f-bdcd8db8d74a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:20.425090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1206d32-eb09-4223-a42f-bdcd8db8d74a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:20.439657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1206d32-eb09-4223-a42f-bdcd8db8d74a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d1206d32-eb09-4223-a42f-bdcd8db8d74a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:20.450087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:20.450965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:20.451769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 150/297] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:41:20.458184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666dbe2-ecc5-4c79-82b0-4074251ae001 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:20.579686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa72dc3-95bd-4dc3-8281-e0d750b00cc9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:20.580004 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa72dc3-95bd-4dc3-8281-e0d750b00cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:20.580586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa72dc3-95bd-4dc3-8281-e0d750b00cc9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:20.581780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 151/298] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:41:20.583613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666dbe2-ecc5-4c79-82b0-4074251ae001 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:20.587397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565cb24-a027-4548-9d40-d6e55a179078 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:20.587683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565cb24-a027-4548-9d40-d6e55a179078 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:20.587962 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565cb24-a027-4548-9d40-d6e55a179078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:20.610058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4565cb24-a027-4548-9d40-d6e55a179078 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:20.611810 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4565cb24-a027-4548-9d40-d6e55a179078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:20.631484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70c82d-82ff-44df-9978-f01b2324a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:20.632446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70c82d-82ff-44df-9978-f01b2324a274 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:20.632926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70c82d-82ff-44df-9978-f01b2324a274 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:20.633307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70c82d-82ff-44df-9978-f01b2324a274 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:20.634231 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70c82d-82ff-44df-9978-f01b2324a274 None admin] RBAC: Adding query filter params (name=member) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:20.634661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70c82d-82ff-44df-9978-f01b2324a274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:20.636140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70c82d-82ff-44df-9978-f01b2324a274 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:20.645902 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 148/299] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:20.651607 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70c82d-82ff-44df-9978-f01b2324a274 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:20.680630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:20.722361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 152/300] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:20.739350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525450d0-061c-4168-87f8-edc21449782b None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:20.739629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525450d0-061c-4168-87f8-edc21449782b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:20.739904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525450d0-061c-4168-87f8-edc21449782b None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:20.741502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 153/301] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:41:20.746375 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a355d9-b8ac-4418-a8bb-d977d6c998a7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:20.746662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a355d9-b8ac-4418-a8bb-d977d6c998a7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:20.746935 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a355d9-b8ac-4418-a8bb-d977d6c998a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:20.763744 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-27a355d9-b8ac-4418-a8bb-d977d6c998a7 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:20.765915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-27a355d9-b8ac-4418-a8bb-d977d6c998a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:20.782253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70c82d-82ff-44df-9978-f01b2324a274 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:20.824117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:20.830999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea3652-ecb4-4992-a52e-1b493490277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:20.831941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea3652-ecb4-4992-a52e-1b493490277e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:20.832219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea3652-ecb4-4992-a52e-1b493490277e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:20.832531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea3652-ecb4-4992-a52e-1b493490277e None admin] PATH_INFO: `/v3/users/fff568f7ce574bf4b6cbaf1618dd61c4` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:20.833757 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea3652-ecb4-4992-a52e-1b493490277e None admin] RBAC: Authorizing `identity:get_user(user_id=fff568f7ce574bf4b6cbaf1618dd61c4)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:20.835286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea3652-ecb4-4992-a52e-1b493490277e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:20.841329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 149/302] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:20 2022] GET /identity/v3/users/fff568f7ce574bf4b6cbaf1618dd61c4 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:20.841329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea3652-ecb4-4992-a52e-1b493490277e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:20.848008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 154/303] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:20.854751 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a355d9-b8ac-4418-a8bb-d977d6c998a7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:20.943126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:20.961532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea3652-ecb4-4992-a52e-1b493490277e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:20.971167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a355d9-b8ac-4418-a8bb-d977d6c998a7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:20.996886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6551004-3194-4b83-8d69-68b0605159d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:20.997709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6551004-3194-4b83-8d69-68b0605159d2 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:20.998013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6551004-3194-4b83-8d69-68b0605159d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:20.998280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6551004-3194-4b83-8d69-68b0605159d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:21.005841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5d093-7dc7-4381-b673-7d3e00644b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:21.006740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5d093-7dc7-4381-b673-7d3e00644b7f None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:21.007024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5d093-7dc7-4381-b673-7d3e00644b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:21.007300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5d093-7dc7-4381-b673-7d3e00644b7f None admin] PATH_INFO: `/v3/system/users/fff568f7ce574bf4b6cbaf1618dd61c4/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:21.008780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5d093-7dc7-4381-b673-7d3e00644b7f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fff568f7ce574bf4b6cbaf1618dd61c4, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:21.010186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5d093-7dc7-4381-b673-7d3e00644b7f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:21.011032 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6551004-3194-4b83-8d69-68b0605159d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:21.019977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 155/304] 10.222.0.81 () {58 vars in 1334 bytes} [Thu Jun 16 14:41:20 2022] PUT /identity/v3/system/users/fff568f7ce574bf4b6cbaf1618dd61c4/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:21.020785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5d093-7dc7-4381-b673-7d3e00644b7f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-f6551004-3194-4b83-8d69-68b0605159d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:21.021392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:21.022274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:21.023053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:21.025057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 150/305] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:21.031533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6551004-3194-4b83-8d69-68b0605159d2 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:21.119345 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:21.181396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6551004-3194-4b83-8d69-68b0605159d2 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:21.184017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5d093-7dc7-4381-b673-7d3e00644b7f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:21.230572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b3f32-9728-4c55-a94f-575b65eaa41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:21.231649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b3f32-9728-4c55-a94f-575b65eaa41d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:21.232165 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b3f32-9728-4c55-a94f-575b65eaa41d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:21.232670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b3f32-9728-4c55-a94f-575b65eaa41d None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:21.233466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23a0a2-cff6-45aa-bd72-e8e636103801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:21.234360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b3f32-9728-4c55-a94f-575b65eaa41d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:21.234975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b3f32-9728-4c55-a94f-575b65eaa41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:21.235124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23a0a2-cff6-45aa-bd72-e8e636103801 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:21.235468 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23a0a2-cff6-45aa-bd72-e8e636103801 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:21.235840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23a0a2-cff6-45aa-bd72-e8e636103801 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:21.237240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23a0a2-cff6-45aa-bd72-e8e636103801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:21.237453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b3f32-9728-4c55-a94f-575b65eaa41d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:21.239393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23a0a2-cff6-45aa-bd72-e8e636103801 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:21.241723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 156/306] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:21.247514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23a0a2-cff6-45aa-bd72-e8e636103801 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:21.251588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 151/307] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:21.257422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b3f32-9728-4c55-a94f-575b65eaa41d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:21.276983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:21.374414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23a0a2-cff6-45aa-bd72-e8e636103801 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:21.388484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b3f32-9728-4c55-a94f-575b65eaa41d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:21.394324 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:21.413874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f7a45-146f-4f96-8716-a4920f170cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:21.414957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f7a45-146f-4f96-8716-a4920f170cca None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:21.415450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f7a45-146f-4f96-8716-a4920f170cca None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:21.415934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f7a45-146f-4f96-8716-a4920f170cca None admin] PATH_INFO: `/v3/groups` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:21.416836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f7a45-146f-4f96-8716-a4920f170cca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:21.418495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f7a45-146f-4f96-8716-a4920f170cca None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:21.430052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45b912-5ea1-4021-b877-b25c9bae0595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:21.430904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45b912-5ea1-4021-b877-b25c9bae0595 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:21.431184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45b912-5ea1-4021-b877-b25c9bae0595 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:21.431463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45b912-5ea1-4021-b877-b25c9bae0595 None admin] PATH_INFO: `/v3/users/795a7f18757c4b9ba3b60fcd7d0c6afd` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:21.445232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 157/308] 10.222.0.81 () {60 vars in 1134 bytes} [Thu Jun 16 14:41:21 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:41:21.451935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45b912-5ea1-4021-b877-b25c9bae0595 None admin] RBAC: Authorizing `identity:get_user(user_id=795a7f18757c4b9ba3b60fcd7d0c6afd)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:21.454190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45b912-5ea1-4021-b877-b25c9bae0595 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:21.456403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 152/309] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:21 2022] GET /identity/v3/users/795a7f18757c4b9ba3b60fcd7d0c6afd => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:21.462196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f7a45-146f-4f96-8716-a4920f170cca None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:21.584519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f7a45-146f-4f96-8716-a4920f170cca None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:21.623469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd05e90-845f-48d3-adee-5fd302b82970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:21.624139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd05e90-845f-48d3-adee-5fd302b82970 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:21.625135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd05e90-845f-48d3-adee-5fd302b82970 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:21.625490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd05e90-845f-48d3-adee-5fd302b82970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:21.626364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd05e90-845f-48d3-adee-5fd302b82970 None admin] RBAC: Adding query filter params (role.id=8465efbb92344621a8ddda3834211a46, user.id=795a7f18757c4b9ba3b60fcd7d0c6afd, scope.system=all) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:21.626677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd05e90-845f-48d3-adee-5fd302b82970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:21.628186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd05e90-845f-48d3-adee-5fd302b82970 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:21.635126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 158/310] 10.222.0.81 () {56 vars in 1308 bytes} [Thu Jun 16 14:41:21 2022] GET /identity/v3/role_assignments?user.id=795a7f18757c4b9ba3b60fcd7d0c6afd&scope.system=all&role.id=8465efbb92344621a8ddda3834211a46 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:21.833696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f650de-0215-441e-8d9a-0637e9b4fb15 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:21.834224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f650de-0215-441e-8d9a-0637e9b4fb15 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:21.834299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f650de-0215-441e-8d9a-0637e9b4fb15 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:21.835969 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 153/311] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:21.841439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585d8ae-bd20-4807-a242-5e74017df62e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:21.841729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585d8ae-bd20-4807-a242-5e74017df62e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:21.842040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585d8ae-bd20-4807-a242-5e74017df62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:21.860713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9585d8ae-bd20-4807-a242-5e74017df62e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:21.861943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9585d8ae-bd20-4807-a242-5e74017df62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:21.899518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:21.941997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 159/312] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:21.959878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f650de-0215-441e-8d9a-0637e9b4fb15 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:22.032297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:22.069720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f650de-0215-441e-8d9a-0637e9b4fb15 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:22.107068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf16f2-aab9-44de-af42-f00c8a33b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:22.107895 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf16f2-aab9-44de-af42-f00c8a33b699 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:22.108184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf16f2-aab9-44de-af42-f00c8a33b699 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:22.108461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf16f2-aab9-44de-af42-f00c8a33b699 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:22.119839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf16f2-aab9-44de-af42-f00c8a33b699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-09cf16f2-aab9-44de-af42-f00c8a33b699 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:22.128602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:22.129516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:22.130343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 154/313] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:22.136085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585d8ae-bd20-4807-a242-5e74017df62e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:22.247433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585d8ae-bd20-4807-a242-5e74017df62e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:22.284135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9779442-ae11-434c-8852-96e43c62517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:22.284977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9779442-ae11-434c-8852-96e43c62517e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:22.285267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9779442-ae11-434c-8852-96e43c62517e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:22.285546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9779442-ae11-434c-8852-96e43c62517e None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:22.286351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9779442-ae11-434c-8852-96e43c62517e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:22.286660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9779442-ae11-434c-8852-96e43c62517e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:22.288060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9779442-ae11-434c-8852-96e43c62517e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:22.298446 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 160/314] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:22.307107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf16f2-aab9-44de-af42-f00c8a33b699 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:22.414664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf16f2-aab9-44de-af42-f00c8a33b699 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:22.441959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:22.451205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4635717-ab37-4adb-b18d-2024d2780e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:22.452097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4635717-ab37-4adb-b18d-2024d2780e11 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:22.452466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4635717-ab37-4adb-b18d-2024d2780e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:22.452807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4635717-ab37-4adb-b18d-2024d2780e11 None admin] PATH_INFO: `/v3/users/9878c9bbfa2246f3aa0359514b2b2ab9` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:22.454191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4635717-ab37-4adb-b18d-2024d2780e11 None admin] RBAC: Authorizing `identity:get_user(user_id=9878c9bbfa2246f3aa0359514b2b2ab9)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:22.455743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4635717-ab37-4adb-b18d-2024d2780e11 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:22.461948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 155/315] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:22 2022] GET /identity/v3/users/9878c9bbfa2246f3aa0359514b2b2ab9 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:22.463348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9779442-ae11-434c-8852-96e43c62517e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:22.500639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:22.574611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9779442-ae11-434c-8852-96e43c62517e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:22.610848 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea286139-22fd-4053-8140-beed41364ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:22.611506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea286139-22fd-4053-8140-beed41364ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:22.611790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea286139-22fd-4053-8140-beed41364ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:22.612065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea286139-22fd-4053-8140-beed41364ab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:22.681957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea286139-22fd-4053-8140-beed41364ab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:22.683378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea286139-22fd-4053-8140-beed41364ab4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:22.726281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:22.789420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 161/316] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:22.795287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4635717-ab37-4adb-b18d-2024d2780e11 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:22.907865 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4635717-ab37-4adb-b18d-2024d2780e11 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:22.943663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc3f26-71b3-43ee-bf31-c8de4036d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:22.944459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc3f26-71b3-43ee-bf31-c8de4036d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:22.944746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc3f26-71b3-43ee-bf31-c8de4036d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:22.945025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc3f26-71b3-43ee-bf31-c8de4036d1f6 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:22.946255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc3f26-71b3-43ee-bf31-c8de4036d1f6 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:22.947697 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc3f26-71b3-43ee-bf31-c8de4036d1f6 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:22.949390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 156/317] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:22 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:22.955849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea286139-22fd-4053-8140-beed41364ab4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:23.058266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea286139-22fd-4053-8140-beed41364ab4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:23.094177 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d76be6-1525-4829-a117-bcea1b18fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:23.094919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d76be6-1525-4829-a117-bcea1b18fc2b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:23.095208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d76be6-1525-4829-a117-bcea1b18fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:23.095486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d76be6-1525-4829-a117-bcea1b18fc2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:23.096327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d76be6-1525-4829-a117-bcea1b18fc2b None admin] RBAC: Adding query filter params (role.id=8465efbb92344621a8ddda3834211a46, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0, user.id=9878c9bbfa2246f3aa0359514b2b2ab9) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:23.096646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d76be6-1525-4829-a117-bcea1b18fc2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:23.098170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d76be6-1525-4829-a117-bcea1b18fc2b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:23.102558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:23.104622 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 162/318] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:22 2022] GET /identity/v3/role_assignments?user.id=9878c9bbfa2246f3aa0359514b2b2ab9&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=8465efbb92344621a8ddda3834211a46 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:23.235571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed76c3-562a-4810-b6f5-34696fae8b07 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:23.235833 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed76c3-562a-4810-b6f5-34696fae8b07 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:23.236053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed76c3-562a-4810-b6f5-34696fae8b07 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:23.237786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 157/319] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:23.243385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0892-a8de-45f4-94d8-7e4c28adf7a3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:23.243671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0892-a8de-45f4-94d8-7e4c28adf7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:23.243953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0892-a8de-45f4-94d8-7e4c28adf7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:23.263058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7b5d0892-a8de-45f4-94d8-7e4c28adf7a3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:23.264337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7b5d0892-a8de-45f4-94d8-7e4c28adf7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:23.344459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 163/320] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:23.367698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed76c3-562a-4810-b6f5-34696fae8b07 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:23.432573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:23.473320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed76c3-562a-4810-b6f5-34696fae8b07 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:23.507374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045b4b5-d890-4729-ad91-692ed70b1e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:23.508092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045b4b5-d890-4729-ad91-692ed70b1e2c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:23.508374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045b4b5-d890-4729-ad91-692ed70b1e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:23.508647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045b4b5-d890-4729-ad91-692ed70b1e2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:23.519934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045b4b5-d890-4729-ad91-692ed70b1e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-5045b4b5-d890-4729-ad91-692ed70b1e2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:23.527707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:23.528635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:23.529813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 158/321] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:23.534828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0892-a8de-45f4-94d8-7e4c28adf7a3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:23.643073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0892-a8de-45f4-94d8-7e4c28adf7a3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:23.674143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:23.682898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198a5fc-a895-49ae-9097-cdc5aea221c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:23.683583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a5fc-a895-49ae-9097-cdc5aea221c8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:23.683868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a5fc-a895-49ae-9097-cdc5aea221c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:23.684170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a5fc-a895-49ae-9097-cdc5aea221c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:23.684920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198a5fc-a895-49ae-9097-cdc5aea221c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:23.685230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198a5fc-a895-49ae-9097-cdc5aea221c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:23.686688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198a5fc-a895-49ae-9097-cdc5aea221c8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:23.695659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 164/322] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:23.701085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045b4b5-d890-4729-ad91-692ed70b1e2c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:23.821077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045b4b5-d890-4729-ad91-692ed70b1e2c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:23.849145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:23.851018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95107927-1531-42d6-9753-100f7a253be9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:23.851574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95107927-1531-42d6-9753-100f7a253be9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:23.851911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95107927-1531-42d6-9753-100f7a253be9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:23.853537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 165/323] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:41:23.859007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b033845-5763-4b7f-b774-9251704adcd7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:23.859332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b033845-5763-4b7f-b774-9251704adcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:23.859719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b033845-5763-4b7f-b774-9251704adcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:23.863514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030edd7-27b9-4eaf-8d97-29a37ab340f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:23.864440 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030edd7-27b9-4eaf-8d97-29a37ab340f3 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:23.864722 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030edd7-27b9-4eaf-8d97-29a37ab340f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:23.864997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030edd7-27b9-4eaf-8d97-29a37ab340f3 None admin] PATH_INFO: `/v3/users/fff568f7ce574bf4b6cbaf1618dd61c4` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:23.866427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030edd7-27b9-4eaf-8d97-29a37ab340f3 None admin] RBAC: Authorizing `identity:get_user(user_id=fff568f7ce574bf4b6cbaf1618dd61c4)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:23.867963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030edd7-27b9-4eaf-8d97-29a37ab340f3 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:23.869995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 159/324] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:23 2022] GET /identity/v3/users/fff568f7ce574bf4b6cbaf1618dd61c4 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:23.876578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030edd7-27b9-4eaf-8d97-29a37ab340f3 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:23.884209 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1b033845-5763-4b7f-b774-9251704adcd7 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:23.885615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1b033845-5763-4b7f-b774-9251704adcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:23.963726 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 166/325] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:23.964870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987cdf4-efd1-4ac1-9d51-e54460e9d3d2 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:23.965160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987cdf4-efd1-4ac1-9d51-e54460e9d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:23.965438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987cdf4-efd1-4ac1-9d51-e54460e9d3d2 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:23.966864 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 167/326] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:23.975735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2155d1-f2a7-42a8-881b-143018267c9f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:23.976128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2155d1-f2a7-42a8-881b-143018267c9f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:23.976385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2155d1-f2a7-42a8-881b-143018267c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:23.987254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030edd7-27b9-4eaf-8d97-29a37ab340f3 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:23.993953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cd2155d1-f2a7-42a8-881b-143018267c9f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:23.995158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cd2155d1-f2a7-42a8-881b-143018267c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:24.023364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bbf29-8bf2-4fef-b77d-2bd22e5b00b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:24.024028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bbf29-8bf2-4fef-b77d-2bd22e5b00b7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:24.024311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bbf29-8bf2-4fef-b77d-2bd22e5b00b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:24.024586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bbf29-8bf2-4fef-b77d-2bd22e5b00b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:24.025464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bbf29-8bf2-4fef-b77d-2bd22e5b00b7 None admin] RBAC: Adding query filter params (role.id=764ea3c1356843bca6a7e706c6ba9a20, user.id=fff568f7ce574bf4b6cbaf1618dd61c4, scope.system=all) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:24.025821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bbf29-8bf2-4fef-b77d-2bd22e5b00b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:24.027302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bbf29-8bf2-4fef-b77d-2bd22e5b00b7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:24.039809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 160/327] 10.222.0.81 () {56 vars in 1308 bytes} [Thu Jun 16 14:41:23 2022] GET /identity/v3/role_assignments?user.id=fff568f7ce574bf4b6cbaf1618dd61c4&scope.system=all&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:24.039809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bbf29-8bf2-4fef-b77d-2bd22e5b00b7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:24.071380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 168/328] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:24.094677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2155d1-f2a7-42a8-881b-143018267c9f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:24.110426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:24.157368 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:24.174498 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bbf29-8bf2-4fef-b77d-2bd22e5b00b7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:24.212783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2155d1-f2a7-42a8-881b-143018267c9f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:24.217363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17936a31-2453-46cb-9094-7a9e9e37c0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:24.220086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17936a31-2453-46cb-9094-7a9e9e37c0ae None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:24.220086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17936a31-2453-46cb-9094-7a9e9e37c0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:24.220086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17936a31-2453-46cb-9094-7a9e9e37c0ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:24.221255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17936a31-2453-46cb-9094-7a9e9e37c0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:24.222986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17936a31-2453-46cb-9094-7a9e9e37c0ae None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:24.225664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 161/329] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:24.230699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17936a31-2453-46cb-9094-7a9e9e37c0ae None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:24.259464 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77fba9-20e5-4565-8b30-0478b5aedebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:24.260530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77fba9-20e5-4565-8b30-0478b5aedebe None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:24.260817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77fba9-20e5-4565-8b30-0478b5aedebe None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:24.261096 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77fba9-20e5-4565-8b30-0478b5aedebe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:24.275124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77fba9-20e5-4565-8b30-0478b5aedebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-6c77fba9-20e5-4565-8b30-0478b5aedebe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:24.283907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:24.284787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:24.285957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 169/330] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:24.290948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77fba9-20e5-4565-8b30-0478b5aedebe None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:24.339831 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17936a31-2453-46cb-9094-7a9e9e37c0ae None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:24.356454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:24.378385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a8c61-82d7-419a-9650-29b595ec208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:24.379064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a8c61-82d7-419a-9650-29b595ec208b None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:24.379348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a8c61-82d7-419a-9650-29b595ec208b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:24.379632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a8c61-82d7-419a-9650-29b595ec208b None admin] PATH_INFO: `/v3/groups` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:24.380318 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a8c61-82d7-419a-9650-29b595ec208b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:24.381757 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a8c61-82d7-419a-9650-29b595ec208b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:24.393374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77fba9-20e5-4565-8b30-0478b5aedebe None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:24.396978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 162/331] 10.222.0.81 () {60 vars in 1134 bytes} [Thu Jun 16 14:41:24 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:41:24.403896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:24.431681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e40200-8076-49a9-94e6-51fc49e7d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:24.432368 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40200-8076-49a9-94e6-51fc49e7d881 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:24.432652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40200-8076-49a9-94e6-51fc49e7d881 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:24.432928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40200-8076-49a9-94e6-51fc49e7d881 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:24.433691 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e40200-8076-49a9-94e6-51fc49e7d881 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:24.434029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e40200-8076-49a9-94e6-51fc49e7d881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:24.435463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e40200-8076-49a9-94e6-51fc49e7d881 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:24.445621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 170/332] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:24.451305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a8c61-82d7-419a-9650-29b595ec208b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:24.560121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a8c61-82d7-419a-9650-29b595ec208b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:24.595256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8119c1-28a4-4f1f-94b7-bb1e717083e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:24.596061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8119c1-28a4-4f1f-94b7-bb1e717083e2 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:24.596338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8119c1-28a4-4f1f-94b7-bb1e717083e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:24.596610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8119c1-28a4-4f1f-94b7-bb1e717083e2 None admin] PATH_INFO: `/v3/users/795a7f18757c4b9ba3b60fcd7d0c6afd` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:24.597799 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8119c1-28a4-4f1f-94b7-bb1e717083e2 None admin] RBAC: Authorizing `identity:get_user(user_id=795a7f18757c4b9ba3b60fcd7d0c6afd)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:24.599268 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8119c1-28a4-4f1f-94b7-bb1e717083e2 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:24.600897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 163/333] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:24 2022] GET /identity/v3/users/795a7f18757c4b9ba3b60fcd7d0c6afd => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:24.606523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e40200-8076-49a9-94e6-51fc49e7d881 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:24.723716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e40200-8076-49a9-94e6-51fc49e7d881 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:24.759712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b1f5f-806f-4b4c-bd66-5344805ba708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:24.760597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b1f5f-806f-4b4c-bd66-5344805ba708 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:24.760987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b1f5f-806f-4b4c-bd66-5344805ba708 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:24.761268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b1f5f-806f-4b4c-bd66-5344805ba708 None admin] PATH_INFO: `/v3/system/users/795a7f18757c4b9ba3b60fcd7d0c6afd/roles/8465efbb92344621a8ddda3834211a46` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:24.763143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b1f5f-806f-4b4c-bd66-5344805ba708 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=795a7f18757c4b9ba3b60fcd7d0c6afd, role_id=8465efbb92344621a8ddda3834211a46)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:24.764553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b1f5f-806f-4b4c-bd66-5344805ba708 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:24.775277 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 171/334] 10.222.0.81 () {58 vars in 1334 bytes} [Thu Jun 16 14:41:24 2022] PUT /identity/v3/system/users/795a7f18757c4b9ba3b60fcd7d0c6afd/roles/8465efbb92344621a8ddda3834211a46 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:26.955056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f7d2e-892f-4cb8-8807-e4bc0a42d0f8 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:26.956089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f7d2e-892f-4cb8-8807-e4bc0a42d0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:26.956584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f7d2e-892f-4cb8-8807-e4bc0a42d0f8 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:26.958481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 164/335] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:26.964246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2c3d8-cf0d-4a34-8b13-21b77c81a35a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:26.965122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2c3d8-cf0d-4a34-8b13-21b77c81a35a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:26.965606 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2c3d8-cf0d-4a34-8b13-21b77c81a35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:26.990996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-25b2c3d8-cf0d-4a34-8b13-21b77c81a35a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:26.992569 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-25b2c3d8-cf0d-4a34-8b13-21b77c81a35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:27.025457 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:27.083935 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 172/336] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:27.131585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f7d2e-892f-4cb8-8807-e4bc0a42d0f8 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:27.197328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:27.272755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f7d2e-892f-4cb8-8807-e4bc0a42d0f8 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:27.316847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94da71-44b9-44b6-a9ac-7cc935e47375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:27.317738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94da71-44b9-44b6-a9ac-7cc935e47375 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:27.318068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94da71-44b9-44b6-a9ac-7cc935e47375 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:27.318335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94da71-44b9-44b6-a9ac-7cc935e47375 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:27.334505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94da71-44b9-44b6-a9ac-7cc935e47375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-7a94da71-44b9-44b6-a9ac-7cc935e47375 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:27.345218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:27.346387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:27.347729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 165/337] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:41:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:27.352742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2c3d8-cf0d-4a34-8b13-21b77c81a35a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:27.492392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2c3d8-cf0d-4a34-8b13-21b77c81a35a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:27.537495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1fa94-81ec-4239-99c9-904b08064866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:27.538125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1fa94-81ec-4239-99c9-904b08064866 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:27.538425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1fa94-81ec-4239-99c9-904b08064866 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:27.538682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1fa94-81ec-4239-99c9-904b08064866 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:27.539439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1fa94-81ec-4239-99c9-904b08064866 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:27.539747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1fa94-81ec-4239-99c9-904b08064866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:27.541132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1fa94-81ec-4239-99c9-904b08064866 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:27.550664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 173/338] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:27.556336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1fa94-81ec-4239-99c9-904b08064866 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:27.557482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef767e-dbfc-4eaa-83e7-88fe761fb706 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:27.557834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef767e-dbfc-4eaa-83e7-88fe761fb706 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:27.558208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef767e-dbfc-4eaa-83e7-88fe761fb706 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:27.560208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 166/339] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:27.567536 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a706-017f-49f0-b451-4ca3842eb75d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:27.567885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a706-017f-49f0-b451-4ca3842eb75d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:27.568280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a706-017f-49f0-b451-4ca3842eb75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:27.591358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:27.604775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-8982a706-017f-49f0-b451-4ca3842eb75d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:27.608780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8982a706-017f-49f0-b451-4ca3842eb75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:27.710103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 167/340] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:27.725551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1fa94-81ec-4239-99c9-904b08064866 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:27.742983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982a706-017f-49f0-b451-4ca3842eb75d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:27.798889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee88f2-351e-46c1-8dda-c4a765b252f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:27.799486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee88f2-351e-46c1-8dda-c4a765b252f5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:27.799775 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee88f2-351e-46c1-8dda-c4a765b252f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:27.800052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee88f2-351e-46c1-8dda-c4a765b252f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:27.830316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:27.922235 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee88f2-351e-46c1-8dda-c4a765b252f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:27.923905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee88f2-351e-46c1-8dda-c4a765b252f5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:27.969623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982a706-017f-49f0-b451-4ca3842eb75d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:27.970191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:28.009454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd457b8-0dfe-4370-843d-3a8a3780b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:28.010657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd457b8-0dfe-4370-843d-3a8a3780b621 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:28.011163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd457b8-0dfe-4370-843d-3a8a3780b621 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:28.011643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd457b8-0dfe-4370-843d-3a8a3780b621 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:28.024557 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd457b8-0dfe-4370-843d-3a8a3780b621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-dbd457b8-0dfe-4370-843d-3a8a3780b621 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:28.033374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:28.034383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:28.035348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:28.037633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 168/341] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:28.039156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cec5d-d429-49c8-938b-aaf0ddbeac39 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:28.039586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cec5d-d429-49c8-938b-aaf0ddbeac39 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:28.039989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cec5d-d429-49c8-938b-aaf0ddbeac39 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:28.041492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 169/342] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:28.042822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ad91d-5fa1-4016-b3e3-f31dc607a0b5 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:28.043307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ad91d-5fa1-4016-b3e3-f31dc607a0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:28.043787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ad91d-5fa1-4016-b3e3-f31dc607a0b5 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:28.045211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 170/343] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:28.047411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6fa4-1dfd-4bc7-8aab-04d0c8e905a7 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:28.047912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6fa4-1dfd-4bc7-8aab-04d0c8e905a7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:28.048399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6fa4-1dfd-4bc7-8aab-04d0c8e905a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:28.064238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 174/344] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:28.065018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee88f2-351e-46c1-8dda-c4a765b252f5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:28.071921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-05ea6fa4-1dfd-4bc7-8aab-04d0c8e905a7 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:28.073468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-05ea6fa4-1dfd-4bc7-8aab-04d0c8e905a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:28.151994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 171/345] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:28.154754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8ee0c-7d32-42a4-be11-2422715b91bf None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:28.155390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8ee0c-7d32-42a4-be11-2422715b91bf None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:28.156069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8ee0c-7d32-42a4-be11-2422715b91bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:28.175036 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4ff8ee0c-7d32-42a4-be11-2422715b91bf None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:28.176584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4ff8ee0c-7d32-42a4-be11-2422715b91bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:28.205107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:28.209318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee88f2-351e-46c1-8dda-c4a765b252f5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:28.240769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:28.250915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be558d2-f021-4e10-9aa3-20d73e38ec05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:28.251840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be558d2-f021-4e10-9aa3-20d73e38ec05 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:28.252328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be558d2-f021-4e10-9aa3-20d73e38ec05 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:28.252785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be558d2-f021-4e10-9aa3-20d73e38ec05 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:28.253710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be558d2-f021-4e10-9aa3-20d73e38ec05 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:28.254227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be558d2-f021-4e10-9aa3-20d73e38ec05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:28.255797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be558d2-f021-4e10-9aa3-20d73e38ec05 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:28.256658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 172/346] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:28.257816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8ee0c-7d32-42a4-be11-2422715b91bf None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:28.267394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 175/347] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:28.268353 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be558d2-f021-4e10-9aa3-20d73e38ec05 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:28.383710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be558d2-f021-4e10-9aa3-20d73e38ec05 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:28.391883 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8ee0c-7d32-42a4-be11-2422715b91bf None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:28.423624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be182b-441c-416f-891e-fbbfba5f4bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:28.424820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be182b-441c-416f-891e-fbbfba5f4bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:28.425303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be182b-441c-416f-891e-fbbfba5f4bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:28.425773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be182b-441c-416f-891e-fbbfba5f4bd9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:28.431378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfd86e-c195-4245-917a-ce6c29f07bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:28.432254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfd86e-c195-4245-917a-ce6c29f07bff None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:28.432534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfd86e-c195-4245-917a-ce6c29f07bff None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:28.432808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfd86e-c195-4245-917a-ce6c29f07bff None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:28.434038 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfd86e-c195-4245-917a-ce6c29f07bff None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:28.437149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfd86e-c195-4245-917a-ce6c29f07bff None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:28.439497 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 173/348] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:28 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:28.440626 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfd86e-c195-4245-917a-ce6c29f07bff None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:28.442440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be182b-441c-416f-891e-fbbfba5f4bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-23be182b-441c-416f-891e-fbbfba5f4bd9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:28.450915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:28.451859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:28.452791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 176/349] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:28.453742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be182b-441c-416f-891e-fbbfba5f4bd9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:28.474283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:28.516434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:28.558296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfd86e-c195-4245-917a-ce6c29f07bff None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:28.579465 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be182b-441c-416f-891e-fbbfba5f4bd9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:28.598247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fbc46-2f5a-4181-936b-72915dffc103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:28.599219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fbc46-2f5a-4181-936b-72915dffc103 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:28.599649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fbc46-2f5a-4181-936b-72915dffc103 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:28.600136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fbc46-2f5a-4181-936b-72915dffc103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:28.625920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0ab52-7ffc-4be4-b313-6e9e2d94ac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:28.625920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ab52-7ffc-4be4-b313-6e9e2d94ac12 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:28.625920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ab52-7ffc-4be4-b313-6e9e2d94ac12 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:28.625920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ab52-7ffc-4be4-b313-6e9e2d94ac12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:28.640337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0ab52-7ffc-4be4-b313-6e9e2d94ac12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-06c0ab52-7ffc-4be4-b313-6e9e2d94ac12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:28.649344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:28.650335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:28.651098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:28.654198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 177/350] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:28.655810 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0ab52-7ffc-4be4-b313-6e9e2d94ac12 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:28.684904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fbc46-2f5a-4181-936b-72915dffc103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:28.686792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fbc46-2f5a-4181-936b-72915dffc103 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:28.717714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:28.773470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0ab52-7ffc-4be4-b313-6e9e2d94ac12 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:28.786133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:28.815785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3458f3-23fc-4350-8550-3dfab17cc867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:28.816655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3458f3-23fc-4350-8550-3dfab17cc867 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:28.816936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3458f3-23fc-4350-8550-3dfab17cc867 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:28.817211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3458f3-23fc-4350-8550-3dfab17cc867 None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:28.817519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 174/351] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:28.818594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fbc46-2f5a-4181-936b-72915dffc103 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:28.824618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3458f3-23fc-4350-8550-3dfab17cc867 None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:28.826433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3458f3-23fc-4350-8550-3dfab17cc867 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:28.829595 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 178/352] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:28 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:28.834068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3458f3-23fc-4350-8550-3dfab17cc867 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:28.949939 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fbc46-2f5a-4181-936b-72915dffc103 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:28.974896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3458f3-23fc-4350-8550-3dfab17cc867 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:28.980352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:29.002015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90289def-1f00-4008-9c71-59f57a5d2dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:29.003159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289def-1f00-4008-9c71-59f57a5d2dff None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.004094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289def-1f00-4008-9c71-59f57a5d2dff None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.004389 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289def-1f00-4008-9c71-59f57a5d2dff None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.005182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90289def-1f00-4008-9c71-59f57a5d2dff None admin] RBAC: Adding query filter params (name=reader) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:29.005494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90289def-1f00-4008-9c71-59f57a5d2dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:29.008908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90289def-1f00-4008-9c71-59f57a5d2dff None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:29.017439 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 175/353] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:29.019254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316604a-1f8d-4ce0-8717-f8170a7c4af6 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.019541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316604a-1f8d-4ce0-8717-f8170a7c4af6 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.019817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316604a-1f8d-4ce0-8717-f8170a7c4af6 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.021378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 176/354] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:29.022258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316604a-1f8d-4ce0-8717-f8170a7c4af6 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:29.031989 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fec152-defe-43ab-b465-adeb3fc30f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:29.032701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fec152-defe-43ab-b465-adeb3fc30f41 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.032992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fec152-defe-43ab-b465-adeb3fc30f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.033274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fec152-defe-43ab-b465-adeb3fc30f41 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.034100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fec152-defe-43ab-b465-adeb3fc30f41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:29.034414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fec152-defe-43ab-b465-adeb3fc30f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:29.035851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fec152-defe-43ab-b465-adeb3fc30f41 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:29.047834 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 179/355] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:29.048768 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fec152-defe-43ab-b465-adeb3fc30f41 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:29.093708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:29.154880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316604a-1f8d-4ce0-8717-f8170a7c4af6 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:29.176981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fec152-defe-43ab-b465-adeb3fc30f41 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:29.198141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826ecd5-7f56-4b92-a58c-fa1beb3163a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:29.199190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ecd5-7f56-4b92-a58c-fa1beb3163a5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.199577 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ecd5-7f56-4b92-a58c-fa1beb3163a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.199923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ecd5-7f56-4b92-a58c-fa1beb3163a5 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.201594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826ecd5-7f56-4b92-a58c-fa1beb3163a5 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:29.203313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826ecd5-7f56-4b92-a58c-fa1beb3163a5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:29.204984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 177/356] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:29 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:29.205789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826ecd5-7f56-4b92-a58c-fa1beb3163a5 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:29.222253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455a6fc-d351-4c52-aace-094933b62006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:29.222926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455a6fc-d351-4c52-aace-094933b62006 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.223203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455a6fc-d351-4c52-aace-094933b62006 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.223477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455a6fc-d351-4c52-aace-094933b62006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.224314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455a6fc-d351-4c52-aace-094933b62006 None admin] RBAC: Adding query filter params (group.id=985884b9875f4d2581da91f1b3609875, role.id=ec1f98086b0748cf9d484264d6d60fff, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:29.224633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455a6fc-d351-4c52-aace-094933b62006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:29.226091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455a6fc-d351-4c52-aace-094933b62006 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:29.231950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 180/357] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Jun 16 14:41:29 2022] GET /identity/v3/role_assignments?group.id=985884b9875f4d2581da91f1b3609875&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=ec1f98086b0748cf9d484264d6d60fff => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:29.233314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b02a8-3bb1-40f7-96b7-e37931f2e247 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.233847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b02a8-3bb1-40f7-96b7-e37931f2e247 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.234297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b02a8-3bb1-40f7-96b7-e37931f2e247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.252276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a71b02a8-3bb1-40f7-96b7-e37931f2e247 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:29.253762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a71b02a8-3bb1-40f7-96b7-e37931f2e247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:29.281723 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:29.355047 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826ecd5-7f56-4b92-a58c-fa1beb3163a5 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:29.356045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 181/358] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:29.361677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b02a8-3bb1-40f7-96b7-e37931f2e247 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:29.408839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:29.414779 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af05d7e-a10d-4208-85fd-22ca7ab78062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:29.415693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af05d7e-a10d-4208-85fd-22ca7ab78062 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.415974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af05d7e-a10d-4208-85fd-22ca7ab78062 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.416249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af05d7e-a10d-4208-85fd-22ca7ab78062 None admin] PATH_INFO: `/v3/users/795a7f18757c4b9ba3b60fcd7d0c6afd` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.417870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af05d7e-a10d-4208-85fd-22ca7ab78062 None admin] RBAC: Authorizing `identity:get_user(user_id=795a7f18757c4b9ba3b60fcd7d0c6afd)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:29.419367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af05d7e-a10d-4208-85fd-22ca7ab78062 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:29.422325 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 178/359] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:29 2022] GET /identity/v3/users/795a7f18757c4b9ba3b60fcd7d0c6afd => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:29.422866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ba110-220f-4bfa-baf4-31d5d5592df5 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.423098 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ba110-220f-4bfa-baf4-31d5d5592df5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.423376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ba110-220f-4bfa-baf4-31d5d5592df5 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.424681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 179/360] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:29.426736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ba110-220f-4bfa-baf4-31d5d5592df5 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:29.504759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b02a8-3bb1-40f7-96b7-e37931f2e247 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:29.547787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268c72e-fc69-46ec-ab3b-873d0bb35407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:29.548451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268c72e-fc69-46ec-ab3b-873d0bb35407 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.548733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268c72e-fc69-46ec-ab3b-873d0bb35407 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.549002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268c72e-fc69-46ec-ab3b-873d0bb35407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.574062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ba110-220f-4bfa-baf4-31d5d5592df5 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:29.603352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:29.625294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a7d6-4b27-4bdd-817c-75b565dcf11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:29.626349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a7d6-4b27-4bdd-817c-75b565dcf11c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.626631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a7d6-4b27-4bdd-817c-75b565dcf11c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.626905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a7d6-4b27-4bdd-817c-75b565dcf11c None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.628351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a7d6-4b27-4bdd-817c-75b565dcf11c None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:29.629814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a7d6-4b27-4bdd-817c-75b565dcf11c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:29.631490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 180/361] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:29 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:29.632278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a7d6-4b27-4bdd-817c-75b565dcf11c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:29.639702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268c72e-fc69-46ec-ab3b-873d0bb35407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:29.641532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268c72e-fc69-46ec-ab3b-873d0bb35407 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:29.692103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:29.765739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a7d6-4b27-4bdd-817c-75b565dcf11c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:29.800204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 182/362] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:29.801080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268c72e-fc69-46ec-ab3b-873d0bb35407 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:29.809178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8f49a-b878-4e36-9831-95de98b648e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:29.810802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8f49a-b878-4e36-9831-95de98b648e0 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.811082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8f49a-b878-4e36-9831-95de98b648e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.811343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8f49a-b878-4e36-9831-95de98b648e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.826706 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8f49a-b878-4e36-9831-95de98b648e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-e4c8f49a-b878-4e36-9831-95de98b648e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:29.835531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:29.836464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:29.837281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:29.837928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 181/363] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:41:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:29.841942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ae02-4844-4d17-acb2-3f6efd85eb3d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.841942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ae02-4844-4d17-acb2-3f6efd85eb3d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.841942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ae02-4844-4d17-acb2-3f6efd85eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.856781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-f374ae02-4844-4d17-acb2-3f6efd85eb3d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:29.858006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f374ae02-4844-4d17-acb2-3f6efd85eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:29.915942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:29.941687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268c72e-fc69-46ec-ab3b-873d0bb35407 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:29.947024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 182/364] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:29.948743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374ae02-4844-4d17-acb2-3f6efd85eb3d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:29.982449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:29.994159 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4fd6a-a578-4834-b638-f83992303652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:29.995081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4fd6a-a578-4834-b638-f83992303652 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:29.995506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4fd6a-a578-4834-b638-f83992303652 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:29.995919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4fd6a-a578-4834-b638-f83992303652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:29.996882 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4fd6a-a578-4834-b638-f83992303652 None admin] RBAC: Adding query filter params (role.id=8465efbb92344621a8ddda3834211a46, user.id=795a7f18757c4b9ba3b60fcd7d0c6afd, scope.system=all) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:29.997351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4fd6a-a578-4834-b638-f83992303652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:30.000508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4fd6a-a578-4834-b638-f83992303652 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:30.017110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 183/365] 10.222.0.81 () {56 vars in 1308 bytes} [Thu Jun 16 14:41:29 2022] GET /identity/v3/role_assignments?user.id=795a7f18757c4b9ba3b60fcd7d0c6afd&scope.system=all&role.id=8465efbb92344621a8ddda3834211a46 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:30.017922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4fd6a-a578-4834-b638-f83992303652 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:30.104012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374ae02-4844-4d17-acb2-3f6efd85eb3d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:30.145246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9da8f-5816-4d9e-9a89-10ec7eb5b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:30.146308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9da8f-5816-4d9e-9a89-10ec7eb5b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:30.147306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9da8f-5816-4d9e-9a89-10ec7eb5b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:30.147759 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9da8f-5816-4d9e-9a89-10ec7eb5b0a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:30.149083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9da8f-5816-4d9e-9a89-10ec7eb5b0a7 None admin] RBAC: Adding query filter params (group.id=985884b9875f4d2581da91f1b3609875, role.id=764ea3c1356843bca6a7e706c6ba9a20, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:30.149580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9da8f-5816-4d9e-9a89-10ec7eb5b0a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:30.152338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9da8f-5816-4d9e-9a89-10ec7eb5b0a7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:30.161548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 183/366] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Jun 16 14:41:29 2022] GET /identity/v3/role_assignments?group.id=985884b9875f4d2581da91f1b3609875&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:30.161749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4fd6a-a578-4834-b638-f83992303652 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:30.162907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9da8f-5816-4d9e-9a89-10ec7eb5b0a7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:30.209259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77738834-657c-4c20-ab40-8447ea642a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:30.210305 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738834-657c-4c20-ab40-8447ea642a84 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:30.213927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738834-657c-4c20-ab40-8447ea642a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:30.213927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738834-657c-4c20-ab40-8447ea642a84 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:30.213927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77738834-657c-4c20-ab40-8447ea642a84 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:30.213927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77738834-657c-4c20-ab40-8447ea642a84 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:30.216015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 184/367] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:30 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:30.217036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77738834-657c-4c20-ab40-8447ea642a84 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:30.242028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:30.304953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:30.345864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9da8f-5816-4d9e-9a89-10ec7eb5b0a7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:30.369283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77738834-657c-4c20-ab40-8447ea642a84 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:30.394929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8003f-797f-4852-ba61-934036c4ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:30.395617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8003f-797f-4852-ba61-934036c4ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:30.395900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8003f-797f-4852-ba61-934036c4ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:30.396173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8003f-797f-4852-ba61-934036c4ffe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:30.396937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8003f-797f-4852-ba61-934036c4ffe7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:30.397242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8003f-797f-4852-ba61-934036c4ffe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:30.398744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8003f-797f-4852-ba61-934036c4ffe7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:30.410339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 184/368] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:30.411196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8003f-797f-4852-ba61-934036c4ffe7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:30.416661 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c789a32-66e6-4e2b-a2d2-9152831c548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:30.418394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c789a32-66e6-4e2b-a2d2-9152831c548f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:30.418679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c789a32-66e6-4e2b-a2d2-9152831c548f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:30.418953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c789a32-66e6-4e2b-a2d2-9152831c548f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:30.435272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c789a32-66e6-4e2b-a2d2-9152831c548f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-2c789a32-66e6-4e2b-a2d2-9152831c548f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:30.445461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:30.446497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:30.447912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 185/369] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:41:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:30.448720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c789a32-66e6-4e2b-a2d2-9152831c548f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:30.539784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8003f-797f-4852-ba61-934036c4ffe7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:30.543168 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:30.584035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c789a32-66e6-4e2b-a2d2-9152831c548f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:30.591118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77954599-1fb0-4812-a553-f56f40e7b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:30.591985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77954599-1fb0-4812-a553-f56f40e7b6fe None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:30.592260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77954599-1fb0-4812-a553-f56f40e7b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:30.592530 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77954599-1fb0-4812-a553-f56f40e7b6fe None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:30.596760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77954599-1fb0-4812-a553-f56f40e7b6fe None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:30.598248 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77954599-1fb0-4812-a553-f56f40e7b6fe None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:30.600233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 185/370] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:30 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:30.601113 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77954599-1fb0-4812-a553-f56f40e7b6fe None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:30.616318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:30.648005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9651b-b08e-49f1-80a2-ef540102a2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:30.649301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9651b-b08e-49f1-80a2-ef540102a2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:30.649776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9651b-b08e-49f1-80a2-ef540102a2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:30.650285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9651b-b08e-49f1-80a2-ef540102a2d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:30.738633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77954599-1fb0-4812-a553-f56f40e7b6fe None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:30.747497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9651b-b08e-49f1-80a2-ef540102a2d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:30.749612 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9651b-b08e-49f1-80a2-ef540102a2d0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:30.795379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c209c-f267-4cce-98cb-a3bc75f9a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:30.797406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c209c-f267-4cce-98cb-a3bc75f9a2fb None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:30.797839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c209c-f267-4cce-98cb-a3bc75f9a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:30.798285 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c209c-f267-4cce-98cb-a3bc75f9a2fb None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:30.799669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c209c-f267-4cce-98cb-a3bc75f9a2fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:30.800146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c209c-f267-4cce-98cb-a3bc75f9a2fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:30.803149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c209c-f267-4cce-98cb-a3bc75f9a2fb None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:30.815935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 186/371] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:30.817656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c209c-f267-4cce-98cb-a3bc75f9a2fb None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:30.869712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:30.877915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 186/372] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:30.877915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9651b-b08e-49f1-80a2-ef540102a2d0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:30.900839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:30.959175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c209c-f267-4cce-98cb-a3bc75f9a2fb None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:30.991669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9651b-b08e-49f1-80a2-ef540102a2d0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:30.997411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342eb572-94da-480d-925f-d0f07f396461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:30.998224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342eb572-94da-480d-925f-d0f07f396461 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:30.998655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342eb572-94da-480d-925f-d0f07f396461 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:30.999151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342eb572-94da-480d-925f-d0f07f396461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:31.000120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342eb572-94da-480d-925f-d0f07f396461 None admin] RBAC: Adding query filter params (group.id=985884b9875f4d2581da91f1b3609875, role.id=764ea3c1356843bca6a7e706c6ba9a20, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:31.000576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342eb572-94da-480d-925f-d0f07f396461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:31.002312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342eb572-94da-480d-925f-d0f07f396461 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:31.009469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 187/373] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Jun 16 14:41:30 2022] GET /identity/v3/role_assignments?group.id=985884b9875f4d2581da91f1b3609875&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:31.013966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342eb572-94da-480d-925f-d0f07f396461 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:31.044884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad9b20-b2f6-4f36-97d0-0d1143bd9a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:31.046526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad9b20-b2f6-4f36-97d0-0d1143bd9a2a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:31.047526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad9b20-b2f6-4f36-97d0-0d1143bd9a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:31.048001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad9b20-b2f6-4f36-97d0-0d1143bd9a2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:31.129047 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:31.134679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342eb572-94da-480d-925f-d0f07f396461 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:31.166192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad9b20-b2f6-4f36-97d0-0d1143bd9a2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:31.168021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad9b20-b2f6-4f36-97d0-0d1143bd9a2a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:31.180312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ffc84-4353-4d81-89a5-9612db2a408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:31.183935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ffc84-4353-4d81-89a5-9612db2a408d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:31.184228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ffc84-4353-4d81-89a5-9612db2a408d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:31.184589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ffc84-4353-4d81-89a5-9612db2a408d None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:31.186176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ffc84-4353-4d81-89a5-9612db2a408d None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:31.190516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ffc84-4353-4d81-89a5-9612db2a408d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:31.192610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 188/374] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:31 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:31.199444 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ffc84-4353-4d81-89a5-9612db2a408d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:31.208767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:31.372028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ffc84-4353-4d81-89a5-9612db2a408d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:31.397730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 187/375] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:31.403248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad9b20-b2f6-4f36-97d0-0d1143bd9a2a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:31.442049 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223917cc-9f57-425d-8b35-479b4f77f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:31.444098 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223917cc-9f57-425d-8b35-479b4f77f05a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:31.444722 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223917cc-9f57-425d-8b35-479b4f77f05a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:31.445221 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223917cc-9f57-425d-8b35-479b4f77f05a None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:31.446798 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223917cc-9f57-425d-8b35-479b4f77f05a None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:31.448747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223917cc-9f57-425d-8b35-479b4f77f05a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:31.451867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 189/376] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:31 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:31.458678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223917cc-9f57-425d-8b35-479b4f77f05a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:31.524447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:31.583669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad9b20-b2f6-4f36-97d0-0d1143bd9a2a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:31.616542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:31.646316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223917cc-9f57-425d-8b35-479b4f77f05a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:31.657790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ffc46-d81d-48d2-93a1-e9a2b1eaf8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:31.657790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ffc46-d81d-48d2-93a1-e9a2b1eaf8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:31.657790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ffc46-d81d-48d2-93a1-e9a2b1eaf8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:31.657790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ffc46-d81d-48d2-93a1-e9a2b1eaf8a1 None admin] PATH_INFO: `/v3/projects/d4e16df5d3ec4c65bc803e3fc067e3c7` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:31.658836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ffc46-d81d-48d2-93a1-e9a2b1eaf8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e16df5d3ec4c65bc803e3fc067e3c7)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:31.660388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ffc46-d81d-48d2-93a1-e9a2b1eaf8a1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:31.663878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 188/377] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:31 2022] GET /identity/v3/projects/d4e16df5d3ec4c65bc803e3fc067e3c7 => generated 344 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:31.669663 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ffc46-d81d-48d2-93a1-e9a2b1eaf8a1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:31.720698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa507b5-4285-4dd9-a1cd-d8c7fbf64505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:31.721687 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa507b5-4285-4dd9-a1cd-d8c7fbf64505 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:31.721998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa507b5-4285-4dd9-a1cd-d8c7fbf64505 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:31.722281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa507b5-4285-4dd9-a1cd-d8c7fbf64505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:31.723134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa507b5-4285-4dd9-a1cd-d8c7fbf64505 None admin] RBAC: Adding query filter params (group.id=985884b9875f4d2581da91f1b3609875, role.id=ec1f98086b0748cf9d484264d6d60fff, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:31.723449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa507b5-4285-4dd9-a1cd-d8c7fbf64505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:31.724980 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa507b5-4285-4dd9-a1cd-d8c7fbf64505 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:31.732912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 190/378] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Jun 16 14:41:31 2022] GET /identity/v3/role_assignments?group.id=985884b9875f4d2581da91f1b3609875&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=ec1f98086b0748cf9d484264d6d60fff => generated 260 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:31.734592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed46bad-a4c8-4e54-9e2c-186e2639feb1 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:31.734885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed46bad-a4c8-4e54-9e2c-186e2639feb1 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:31.735167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed46bad-a4c8-4e54-9e2c-186e2639feb1 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:31.736835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 191/379] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:31.758241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042fab7-e036-463e-b8ea-bd57ca4992f7 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:31.758676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042fab7-e036-463e-b8ea-bd57ca4992f7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:31.759025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042fab7-e036-463e-b8ea-bd57ca4992f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:31.799052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-2042fab7-e036-463e-b8ea-bd57ca4992f7 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:31.800376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2042fab7-e036-463e-b8ea-bd57ca4992f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:31.821110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ffc46-d81d-48d2-93a1-e9a2b1eaf8a1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:31.872503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf15241-cb6e-47ad-8c14-2237d858781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:31.873397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf15241-cb6e-47ad-8c14-2237d858781f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:31.873679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf15241-cb6e-47ad-8c14-2237d858781f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:31.874068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf15241-cb6e-47ad-8c14-2237d858781f None admin] PATH_INFO: `/v3/groups/5454fdb2c0a7420b823743fdd5d78b9a` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:31.881564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf15241-cb6e-47ad-8c14-2237d858781f None admin] RBAC: Authorizing `identity:get_group(group_id=5454fdb2c0a7420b823743fdd5d78b9a)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:31.883382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf15241-cb6e-47ad-8c14-2237d858781f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:31.886560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 189/380] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:31 2022] GET /identity/v3/groups/5454fdb2c0a7420b823743fdd5d78b9a => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:31.900171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf15241-cb6e-47ad-8c14-2237d858781f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:31.927441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 192/381] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:31.950746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042fab7-e036-463e-b8ea-bd57ca4992f7 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:31.987499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:32.018807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:32.075002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042fab7-e036-463e-b8ea-bd57ca4992f7 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:32.115335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01040f9f-b31c-482c-a3bd-aaa0488283b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:32.116158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01040f9f-b31c-482c-a3bd-aaa0488283b4 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:32.116437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01040f9f-b31c-482c-a3bd-aaa0488283b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:32.116716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01040f9f-b31c-482c-a3bd-aaa0488283b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:32.128654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01040f9f-b31c-482c-a3bd-aaa0488283b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:32.129987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf15241-cb6e-47ad-8c14-2237d858781f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-01040f9f-b31c-482c-a3bd-aaa0488283b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:32.141156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:32.142468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:32.143256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 193/382] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:41:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:32.150989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01040f9f-b31c-482c-a3bd-aaa0488283b4 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:32.172256 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f347d57-9e90-4807-b73e-81f77f7e58d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:32.172923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f347d57-9e90-4807-b73e-81f77f7e58d0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:32.173196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f347d57-9e90-4807-b73e-81f77f7e58d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:32.173682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f347d57-9e90-4807-b73e-81f77f7e58d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:32.174559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f347d57-9e90-4807-b73e-81f77f7e58d0 None admin] RBAC: Adding query filter params (group.id=5454fdb2c0a7420b823743fdd5d78b9a, role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=d4e16df5d3ec4c65bc803e3fc067e3c7) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:32.174920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f347d57-9e90-4807-b73e-81f77f7e58d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:32.176424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f347d57-9e90-4807-b73e-81f77f7e58d0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:32.186214 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 190/383] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Jun 16 14:41:31 2022] GET /identity/v3/role_assignments?group.id=5454fdb2c0a7420b823743fdd5d78b9a&scope.project.id=d4e16df5d3ec4c65bc803e3fc067e3c7&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 260 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:32.287709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:32.304258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01040f9f-b31c-482c-a3bd-aaa0488283b4 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:32.352604 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e408129-8cbf-456f-b58e-9fb25d4dfa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:32.353319 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e408129-8cbf-456f-b58e-9fb25d4dfa37 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:32.353604 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e408129-8cbf-456f-b58e-9fb25d4dfa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:32.353916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e408129-8cbf-456f-b58e-9fb25d4dfa37 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:32.354668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e408129-8cbf-456f-b58e-9fb25d4dfa37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:32.354978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e408129-8cbf-456f-b58e-9fb25d4dfa37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:32.356397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e408129-8cbf-456f-b58e-9fb25d4dfa37 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:32.367123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 194/384] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:32.372857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f347d57-9e90-4807-b73e-81f77f7e58d0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:32.509717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f347d57-9e90-4807-b73e-81f77f7e58d0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:32.526325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:32.548762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61194b-5d7d-4601-85c2-3ea328764507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:32.549642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61194b-5d7d-4601-85c2-3ea328764507 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:32.549947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61194b-5d7d-4601-85c2-3ea328764507 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:32.550224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61194b-5d7d-4601-85c2-3ea328764507 None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:32.551470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61194b-5d7d-4601-85c2-3ea328764507 None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:32.552909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61194b-5d7d-4601-85c2-3ea328764507 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:32.554913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 191/385] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:32 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:32.560320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e408129-8cbf-456f-b58e-9fb25d4dfa37 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:32.698100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e408129-8cbf-456f-b58e-9fb25d4dfa37 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:32.743720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b37673-de04-4927-b722-2e77959a8134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:32.744609 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b37673-de04-4927-b722-2e77959a8134 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:32.744894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b37673-de04-4927-b722-2e77959a8134 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:32.745173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b37673-de04-4927-b722-2e77959a8134 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:32.751085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b37673-de04-4927-b722-2e77959a8134 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:32.752629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b37673-de04-4927-b722-2e77959a8134 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:32.755034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 195/386] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:32 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:32.761188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61194b-5d7d-4601-85c2-3ea328764507 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:32.868865 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401d76c-13da-4c66-ba45-fbc33830b9cb None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:32.869185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401d76c-13da-4c66-ba45-fbc33830b9cb None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:32.869425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401d76c-13da-4c66-ba45-fbc33830b9cb None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:32.871123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 196/387] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:32.876888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775407d-a408-472e-958a-a3ff3ad8ce47 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:32.877181 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775407d-a408-472e-958a-a3ff3ad8ce47 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:32.877464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775407d-a408-472e-958a-a3ff3ad8ce47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:32.882864 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61194b-5d7d-4601-85c2-3ea328764507 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:32.914973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-0775407d-a408-472e-958a-a3ff3ad8ce47 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:32.916500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0775407d-a408-472e-958a-a3ff3ad8ce47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:32.918488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ad8cf-bdec-49ba-9dba-fce9e17fe13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:32.919382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ad8cf-bdec-49ba-9dba-fce9e17fe13e None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:32.919659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ad8cf-bdec-49ba-9dba-fce9e17fe13e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:32.919931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ad8cf-bdec-49ba-9dba-fce9e17fe13e None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/groups/985884b9875f4d2581da91f1b3609875/roles/ec1f98086b0748cf9d484264d6d60fff` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:32.922417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ad8cf-bdec-49ba-9dba-fce9e17fe13e None admin] RBAC: Authorizing `identity:create_grant(project_id=e7c9534cee7f420a9b48f192ca318f6b, group_id=985884b9875f4d2581da91f1b3609875, role_id=ec1f98086b0748cf9d484264d6d60fff)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:32.923851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ad8cf-bdec-49ba-9dba-fce9e17fe13e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:32.944182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 192/388] 10.222.0.81 () {58 vars in 1442 bytes} [Thu Jun 16 14:41:32 2022] PUT /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/groups/985884b9875f4d2581da91f1b3609875/roles/ec1f98086b0748cf9d484264d6d60fff => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:32.945241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:33.060900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 197/389] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:33.096723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ad8cf-bdec-49ba-9dba-fce9e17fe13e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:33.149411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:33.222866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ad8cf-bdec-49ba-9dba-fce9e17fe13e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:33.258522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edf2f3-cfe9-414c-904f-156700d98290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:33.259329 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edf2f3-cfe9-414c-904f-156700d98290 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:33.259607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edf2f3-cfe9-414c-904f-156700d98290 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:33.259882 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edf2f3-cfe9-414c-904f-156700d98290 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:33.271716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edf2f3-cfe9-414c-904f-156700d98290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-54edf2f3-cfe9-414c-904f-156700d98290 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:33.279430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:33.280497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:33.281568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:33.285123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 193/390] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:33.287434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775407d-a408-472e-958a-a3ff3ad8ce47 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:33.396080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775407d-a408-472e-958a-a3ff3ad8ce47 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:33.432606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12118cd-6c2b-4cb9-bc39-a3a6412ae791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:33.433335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12118cd-6c2b-4cb9-bc39-a3a6412ae791 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:33.433612 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12118cd-6c2b-4cb9-bc39-a3a6412ae791 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:33.434008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12118cd-6c2b-4cb9-bc39-a3a6412ae791 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:33.434762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12118cd-6c2b-4cb9-bc39-a3a6412ae791 None admin] RBAC: Adding query filter params (name=member) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:33.435065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12118cd-6c2b-4cb9-bc39-a3a6412ae791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:33.436492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12118cd-6c2b-4cb9-bc39-a3a6412ae791 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:33.450064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 198/391] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:33.452513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edf2f3-cfe9-414c-904f-156700d98290 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:33.560233 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edf2f3-cfe9-414c-904f-156700d98290 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:33.567868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:33.599243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5714fdf-52c7-4f1c-9999-7d17650fd3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:33.600153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5714fdf-52c7-4f1c-9999-7d17650fd3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:33.600437 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5714fdf-52c7-4f1c-9999-7d17650fd3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:33.600711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5714fdf-52c7-4f1c-9999-7d17650fd3b4 None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:33.606576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5714fdf-52c7-4f1c-9999-7d17650fd3b4 None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:33.608024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5714fdf-52c7-4f1c-9999-7d17650fd3b4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:33.610059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 194/392] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:33 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:33.615533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12118cd-6c2b-4cb9-bc39-a3a6412ae791 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:33.636089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:33.731870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12118cd-6c2b-4cb9-bc39-a3a6412ae791 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:33.768213 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8f659-bc67-4031-b470-2bcd5a45f240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:33.769090 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8f659-bc67-4031-b470-2bcd5a45f240 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:33.769413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8f659-bc67-4031-b470-2bcd5a45f240 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:33.769691 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8f659-bc67-4031-b470-2bcd5a45f240 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:33.770951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8f659-bc67-4031-b470-2bcd5a45f240 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:33.772399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8f659-bc67-4031-b470-2bcd5a45f240 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:33.778020 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 199/393] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:33 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:33.780775 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5714fdf-52c7-4f1c-9999-7d17650fd3b4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:33.899500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5714fdf-52c7-4f1c-9999-7d17650fd3b4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:33.939289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df482bf9-85de-456b-a71f-544287a324a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:33.940401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482bf9-85de-456b-a71f-544287a324a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:33.940847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482bf9-85de-456b-a71f-544287a324a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:33.941265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482bf9-85de-456b-a71f-544287a324a7 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/groups/985884b9875f4d2581da91f1b3609875/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:33.943514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df482bf9-85de-456b-a71f-544287a324a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7c9534cee7f420a9b48f192ca318f6b, group_id=985884b9875f4d2581da91f1b3609875, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:33.945150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df482bf9-85de-456b-a71f-544287a324a7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:33.963919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 195/394] 10.222.0.81 () {58 vars in 1442 bytes} [Thu Jun 16 14:41:33 2022] PUT /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b/groups/985884b9875f4d2581da91f1b3609875/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:34.130940 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a143a8-0940-4769-98ed-89c6e2447ebf None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:34.131247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a143a8-0940-4769-98ed-89c6e2447ebf None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:34.131560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a143a8-0940-4769-98ed-89c6e2447ebf None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:34.133300 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 200/395] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:34.139366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd16f5-3182-479c-a6c5-df545e4ed8b3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:34.141128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd16f5-3182-479c-a6c5-df545e4ed8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:34.141128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd16f5-3182-479c-a6c5-df545e4ed8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:34.163880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b7fd16f5-3182-479c-a6c5-df545e4ed8b3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:34.165253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b7fd16f5-3182-479c-a6c5-df545e4ed8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:34.201448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:34.268329 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 196/396] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:34.292303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a143a8-0940-4769-98ed-89c6e2447ebf None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:34.388445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:34.421911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a143a8-0940-4769-98ed-89c6e2447ebf None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:34.473792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67e5ea-4ca2-4529-9d59-3b6eebf07baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:34.474547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e5ea-4ca2-4529-9d59-3b6eebf07baf None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:34.474830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e5ea-4ca2-4529-9d59-3b6eebf07baf None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:34.475105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e5ea-4ca2-4529-9d59-3b6eebf07baf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:34.490323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67e5ea-4ca2-4529-9d59-3b6eebf07baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-2c67e5ea-4ca2-4529-9d59-3b6eebf07baf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:34.499383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:34.500254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:34.501027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 201/397] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:34.506986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd16f5-3182-479c-a6c5-df545e4ed8b3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:34.661609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd16f5-3182-479c-a6c5-df545e4ed8b3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:34.733118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe9977-b0f9-4798-a7d3-bb39778c757f None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:34.733922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe9977-b0f9-4798-a7d3-bb39778c757f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:34.734189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe9977-b0f9-4798-a7d3-bb39778c757f None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:34.734288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154bf71-9d0c-4ea6-ab55-08a193bd6c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:34.734986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154bf71-9d0c-4ea6-ab55-08a193bd6c82 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:34.735267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154bf71-9d0c-4ea6-ab55-08a193bd6c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:34.735539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154bf71-9d0c-4ea6-ab55-08a193bd6c82 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:34.735825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 202/398] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:34.736326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154bf71-9d0c-4ea6-ab55-08a193bd6c82 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:34.736635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154bf71-9d0c-4ea6-ab55-08a193bd6c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:34.738123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154bf71-9d0c-4ea6-ab55-08a193bd6c82 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:34.741082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b13c7-8582-4a71-b1a9-f249941defc4 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:34.741366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b13c7-8582-4a71-b1a9-f249941defc4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:34.741643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b13c7-8582-4a71-b1a9-f249941defc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:34.753944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 197/399] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:34.759584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154bf71-9d0c-4ea6-ab55-08a193bd6c82 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:34.761225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-512b13c7-8582-4a71-b1a9-f249941defc4 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:34.762994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-512b13c7-8582-4a71-b1a9-f249941defc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:34.804243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:34.877909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 203/400] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:34.894651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b13c7-8582-4a71-b1a9-f249941defc4 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:34.942275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154bf71-9d0c-4ea6-ab55-08a193bd6c82 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:34.980140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:34.992130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce59008-33da-44d1-8173-c18436e69543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:34.993028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce59008-33da-44d1-8173-c18436e69543 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:34.993303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce59008-33da-44d1-8173-c18436e69543 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:34.993571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce59008-33da-44d1-8173-c18436e69543 None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:34.994801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce59008-33da-44d1-8173-c18436e69543 None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:34.996353 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce59008-33da-44d1-8173-c18436e69543 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:34.998413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 198/401] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:34 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:35.000007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2b97-5c92-4e27-8f59-4a5d30cdc9c1 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.000288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2b97-5c92-4e27-8f59-4a5d30cdc9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.000561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2b97-5c92-4e27-8f59-4a5d30cdc9c1 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.005938 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 199/402] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:35.006721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df2b97-5c92-4e27-8f59-4a5d30cdc9c1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:35.036265 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b13c7-8582-4a71-b1a9-f249941defc4 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:35.077946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8edd1-9bc4-44d0-bf40-39b0d11666e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:35.078762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8edd1-9bc4-44d0-bf40-39b0d11666e9 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.079039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8edd1-9bc4-44d0-bf40-39b0d11666e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.079305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8edd1-9bc4-44d0-bf40-39b0d11666e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.090589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8edd1-9bc4-44d0-bf40-39b0d11666e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-a5e8edd1-9bc4-44d0-bf40-39b0d11666e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:35.100045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:35.100946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:35.101711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 204/403] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:41:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:41:35.102890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2e6e-3ad4-4ea0-a44b-86e1cdf8235c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.105909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2e6e-3ad4-4ea0-a44b-86e1cdf8235c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.105909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2e6e-3ad4-4ea0-a44b-86e1cdf8235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.121190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:35.126505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ca8d2e6e-3ad4-4ea0-a44b-86e1cdf8235c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:35.128627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ca8d2e6e-3ad4-4ea0-a44b-86e1cdf8235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:35.138542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df2b97-5c92-4e27-8f59-4a5d30cdc9c1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:35.176517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b98ec2-8819-45a0-828e-a938a3a05cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:35.177380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b98ec2-8819-45a0-828e-a938a3a05cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.177661 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b98ec2-8819-45a0-828e-a938a3a05cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.177954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b98ec2-8819-45a0-828e-a938a3a05cc9 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.179150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b98ec2-8819-45a0-828e-a938a3a05cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:35.180566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b98ec2-8819-45a0-828e-a938a3a05cc9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:35.182722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 200/404] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:35 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:35.183487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b98ec2-8819-45a0-828e-a938a3a05cc9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:35.226379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 205/405] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:35.227257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d2e6e-3ad4-4ea0-a44b-86e1cdf8235c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:35.300095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:35.326447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b98ec2-8819-45a0-828e-a938a3a05cc9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:35.352280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d2e6e-3ad4-4ea0-a44b-86e1cdf8235c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:35.370408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9119ea-00a1-4fc0-ae94-cf50c7ee4caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:35.371139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9119ea-00a1-4fc0-ae94-cf50c7ee4caf None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.371601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9119ea-00a1-4fc0-ae94-cf50c7ee4caf None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.371934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9119ea-00a1-4fc0-ae94-cf50c7ee4caf None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.372743 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9119ea-00a1-4fc0-ae94-cf50c7ee4caf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:35.373551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9119ea-00a1-4fc0-ae94-cf50c7ee4caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:35.375893 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9119ea-00a1-4fc0-ae94-cf50c7ee4caf None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:35.392362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 201/406] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:35.393639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9119ea-00a1-4fc0-ae94-cf50c7ee4caf None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:35.401548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44199f-797b-41fe-860c-93d4d6c679f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:35.402484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44199f-797b-41fe-860c-93d4d6c679f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.402765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44199f-797b-41fe-860c-93d4d6c679f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.403035 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44199f-797b-41fe-860c-93d4d6c679f5 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/groups/985884b9875f4d2581da91f1b3609875/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.405228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44199f-797b-41fe-860c-93d4d6c679f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdc2b03f47c482d8d86dbba1db20be0, group_id=985884b9875f4d2581da91f1b3609875, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:35.407084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44199f-797b-41fe-860c-93d4d6c679f5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:35.416818 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:35.424498 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 206/407] 10.222.0.81 () {58 vars in 1442 bytes} [Thu Jun 16 14:41:35 2022] PUT /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/groups/985884b9875f4d2581da91f1b3609875/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:35.425765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44199f-797b-41fe-860c-93d4d6c679f5 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:35.550518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9119ea-00a1-4fc0-ae94-cf50c7ee4caf None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:35.615696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfabd54-b12f-4aab-8541-eaa5e472fb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:35.616511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfabd54-b12f-4aab-8541-eaa5e472fb8a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.616787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfabd54-b12f-4aab-8541-eaa5e472fb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.617055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfabd54-b12f-4aab-8541-eaa5e472fb8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.636309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfabd54-b12f-4aab-8541-eaa5e472fb8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:35.637288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44199f-797b-41fe-860c-93d4d6c679f5 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-adfabd54-b12f-4aab-8541-eaa5e472fb8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:35.647152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:35.648048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:35.648853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:35.652646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 202/408] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:41:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:35.667424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfabd54-b12f-4aab-8541-eaa5e472fb8a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:35.667674 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:35.685572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d4434-169e-4763-a6e0-a4e1cd989a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:35.687486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4434-169e-4763-a6e0-a4e1cd989a17 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.688179 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4434-169e-4763-a6e0-a4e1cd989a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.688857 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4434-169e-4763-a6e0-a4e1cd989a17 None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.690312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d4434-169e-4763-a6e0-a4e1cd989a17 None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:35.691988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d4434-169e-4763-a6e0-a4e1cd989a17 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:35.693843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 207/409] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:35 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:35.699705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d4434-169e-4763-a6e0-a4e1cd989a17 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:35.833306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d4434-169e-4763-a6e0-a4e1cd989a17 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:35.854427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:35.874613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069ee8d-0a7f-452c-a5a9-a7e53a5dda33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:35.875996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ee8d-0a7f-452c-a5a9-a7e53a5dda33 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.876499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ee8d-0a7f-452c-a5a9-a7e53a5dda33 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.877021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ee8d-0a7f-452c-a5a9-a7e53a5dda33 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.878465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069ee8d-0a7f-452c-a5a9-a7e53a5dda33 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:35.878845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfabd54-b12f-4aab-8541-eaa5e472fb8a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:35.880457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069ee8d-0a7f-452c-a5a9-a7e53a5dda33 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:35.882868 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 208/410] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:35 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:35.884328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1adf-f84d-46ec-8f17-40e33e20331b None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.885106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1adf-f84d-46ec-8f17-40e33e20331b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.885785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1adf-f84d-46ec-8f17-40e33e20331b None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.888356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 209/411] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:35.889236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a1adf-f84d-46ec-8f17-40e33e20331b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:35.924249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290047fc-f50e-4075-a6c8-c42ee4c85a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:35.924930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290047fc-f50e-4075-a6c8-c42ee4c85a66 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.925211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290047fc-f50e-4075-a6c8-c42ee4c85a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.925492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290047fc-f50e-4075-a6c8-c42ee4c85a66 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.926426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290047fc-f50e-4075-a6c8-c42ee4c85a66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:35.926734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290047fc-f50e-4075-a6c8-c42ee4c85a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:35.928721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290047fc-f50e-4075-a6c8-c42ee4c85a66 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:35.940414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 203/412] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:35.942214 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a6199-642b-49fc-b43c-89c758943310 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:35.942506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a6199-642b-49fc-b43c-89c758943310 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:35.942782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a6199-642b-49fc-b43c-89c758943310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:35.956865 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:35.963997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4e1a6199-642b-49fc-b43c-89c758943310 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:35.965359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4e1a6199-642b-49fc-b43c-89c758943310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:36.008141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a1adf-f84d-46ec-8f17-40e33e20331b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:36.046473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4dd9e-2783-465f-9518-75a44ea2ee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:36.047835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4dd9e-2783-465f-9518-75a44ea2ee5b None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:36.048314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4dd9e-2783-465f-9518-75a44ea2ee5b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:36.048813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4dd9e-2783-465f-9518-75a44ea2ee5b None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/groups/985884b9875f4d2581da91f1b3609875/roles/ec1f98086b0748cf9d484264d6d60fff` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:36.051401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4dd9e-2783-465f-9518-75a44ea2ee5b None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdc2b03f47c482d8d86dbba1db20be0, group_id=985884b9875f4d2581da91f1b3609875, role_id=ec1f98086b0748cf9d484264d6d60fff)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:36.053099 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4dd9e-2783-465f-9518-75a44ea2ee5b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:36.057968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 204/413] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:36.059200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a6199-642b-49fc-b43c-89c758943310 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:36.074413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 210/414] 10.222.0.81 () {58 vars in 1442 bytes} [Thu Jun 16 14:41:35 2022] PUT /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0/groups/985884b9875f4d2581da91f1b3609875/roles/ec1f98086b0748cf9d484264d6d60fff => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:36.115568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4dd9e-2783-465f-9518-75a44ea2ee5b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:36.183374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:36.225642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a6199-642b-49fc-b43c-89c758943310 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:36.305668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd8208-af7c-4daa-b990-d73b18b2f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:36.306839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd8208-af7c-4daa-b990-d73b18b2f0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:36.307120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd8208-af7c-4daa-b990-d73b18b2f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:36.307555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd8208-af7c-4daa-b990-d73b18b2f0a5 None admin] PATH_INFO: `/v3/groups/5454fdb2c0a7420b823743fdd5d78b9a` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:36.309342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd8208-af7c-4daa-b990-d73b18b2f0a5 None admin] RBAC: Authorizing `identity:get_group(group_id=5454fdb2c0a7420b823743fdd5d78b9a)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:36.310840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd8208-af7c-4daa-b990-d73b18b2f0a5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:36.315248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 205/415] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:36 2022] GET /identity/v3/groups/5454fdb2c0a7420b823743fdd5d78b9a => generated 229 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:36.320753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd8208-af7c-4daa-b990-d73b18b2f0a5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:36.323480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4dd9e-2783-465f-9518-75a44ea2ee5b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:36.340876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:36.366841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd514a-c78f-4d4f-81f6-7c2479c91188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:36.367837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd514a-c78f-4d4f-81f6-7c2479c91188 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:36.368124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd514a-c78f-4d4f-81f6-7c2479c91188 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:36.368401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd514a-c78f-4d4f-81f6-7c2479c91188 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:36.381859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd514a-c78f-4d4f-81f6-7c2479c91188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-6dbd514a-c78f-4d4f-81f6-7c2479c91188 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:36.397013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:36.398254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:36.399262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:36.402471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 211/416] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:41:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:41:36.411146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd514a-c78f-4d4f-81f6-7c2479c91188 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:36.471823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd8208-af7c-4daa-b990-d73b18b2f0a5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:36.521641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3e328-429e-46b1-a3ca-87649096fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:36.522639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3e328-429e-46b1-a3ca-87649096fbcd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:36.522991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3e328-429e-46b1-a3ca-87649096fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:36.523333 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3e328-429e-46b1-a3ca-87649096fbcd None admin] PATH_INFO: `/v3/projects/d4e16df5d3ec4c65bc803e3fc067e3c7` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:36.525115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3e328-429e-46b1-a3ca-87649096fbcd None admin] RBAC: Authorizing `identity:get_project(project_id=d4e16df5d3ec4c65bc803e3fc067e3c7)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:36.526845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3e328-429e-46b1-a3ca-87649096fbcd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:36.528655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 206/417] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:36 2022] GET /identity/v3/projects/d4e16df5d3ec4c65bc803e3fc067e3c7 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:36.535921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3e328-429e-46b1-a3ca-87649096fbcd None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:36.547147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:36.652390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3e328-429e-46b1-a3ca-87649096fbcd None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:36.691964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd514a-c78f-4d4f-81f6-7c2479c91188 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:36.694317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df7300-db74-4f3d-a087-f620c713c377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:36.696371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df7300-db74-4f3d-a087-f620c713c377 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:36.696748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df7300-db74-4f3d-a087-f620c713c377 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:36.697102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df7300-db74-4f3d-a087-f620c713c377 None admin] PATH_INFO: `/v3/projects/d4e16df5d3ec4c65bc803e3fc067e3c7/groups/5454fdb2c0a7420b823743fdd5d78b9a/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:36.699434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df7300-db74-4f3d-a087-f620c713c377 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4e16df5d3ec4c65bc803e3fc067e3c7, group_id=5454fdb2c0a7420b823743fdd5d78b9a, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:36.701000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df7300-db74-4f3d-a087-f620c713c377 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:36.733566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 207/418] 10.222.0.81 () {58 vars in 1442 bytes} [Thu Jun 16 14:41:36 2022] PUT /identity/v3/projects/d4e16df5d3ec4c65bc803e3fc067e3c7/groups/5454fdb2c0a7420b823743fdd5d78b9a/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:36.763181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2196b3e-f39d-492b-aece-3b07967abec9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:36.763477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2196b3e-f39d-492b-aece-3b07967abec9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:36.763843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2196b3e-f39d-492b-aece-3b07967abec9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:36.767444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 208/419] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:36.770785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1a9d8-189e-461a-a328-1ce009a3988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:36.771506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1a9d8-189e-461a-a328-1ce009a3988f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:36.771794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1a9d8-189e-461a-a328-1ce009a3988f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:36.772074 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1a9d8-189e-461a-a328-1ce009a3988f None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:36.772870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1a9d8-189e-461a-a328-1ce009a3988f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:36.773191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1a9d8-189e-461a-a328-1ce009a3988f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:36.774685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1a9d8-189e-461a-a328-1ce009a3988f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:36.778950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206050-ea19-4fa6-84ef-8fc5eb3e03eb None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:36.779288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206050-ea19-4fa6-84ef-8fc5eb3e03eb None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:36.779574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206050-ea19-4fa6-84ef-8fc5eb3e03eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:36.798670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 212/420] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:36.802333 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-54206050-ea19-4fa6-84ef-8fc5eb3e03eb None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:36.803694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-54206050-ea19-4fa6-84ef-8fc5eb3e03eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:36.808208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1a9d8-189e-461a-a328-1ce009a3988f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:36.860409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:36.940977 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1a9d8-189e-461a-a328-1ce009a3988f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:36.955169 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:36.962686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 209/421] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:36.980287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331502-8363-4824-a8aa-82af129ffda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:36.981087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331502-8363-4824-a8aa-82af129ffda6 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:36.981447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331502-8363-4824-a8aa-82af129ffda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:36.981795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331502-8363-4824-a8aa-82af129ffda6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:36.988575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206050-ea19-4fa6-84ef-8fc5eb3e03eb None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:37.068438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53331502-8363-4824-a8aa-82af129ffda6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:37.071050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53331502-8363-4824-a8aa-82af129ffda6 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:37.110250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:37.167926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206050-ea19-4fa6-84ef-8fc5eb3e03eb None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:37.184934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 213/422] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:41:37.190167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331502-8363-4824-a8aa-82af129ffda6 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:37.226450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee829ec-cc73-4b78-ae18-c7479b92f2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:37.227175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee829ec-cc73-4b78-ae18-c7479b92f2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:37.227457 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee829ec-cc73-4b78-ae18-c7479b92f2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:37.227730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee829ec-cc73-4b78-ae18-c7479b92f2a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:37.240498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee829ec-cc73-4b78-ae18-c7479b92f2a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-5ee829ec-cc73-4b78-ae18-c7479b92f2a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:37.248971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:37.250487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:37.251251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 210/423] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:41:37.257707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee829ec-cc73-4b78-ae18-c7479b92f2a5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:37.355024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:37.397200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331502-8363-4824-a8aa-82af129ffda6 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:37.432747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee829ec-cc73-4b78-ae18-c7479b92f2a5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:37.446700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b2f7-11d4-4742-b29c-c27fb00faf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:37.447589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b2f7-11d4-4742-b29c-c27fb00faf48 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:37.447870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b2f7-11d4-4742-b29c-c27fb00faf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:37.448140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b2f7-11d4-4742-b29c-c27fb00faf48 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:37.451042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2b2f7-11d4-4742-b29c-c27fb00faf48 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:37.453335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2b2f7-11d4-4742-b29c-c27fb00faf48 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:37.459466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 214/424] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:37 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:37.460280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b2f7-11d4-4742-b29c-c27fb00faf48 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:37.467040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:37.498236 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4183ad-f0a2-455a-81d6-e1076ece4535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:37.499404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4183ad-f0a2-455a-81d6-e1076ece4535 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:37.500259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4183ad-f0a2-455a-81d6-e1076ece4535 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:37.500541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4183ad-f0a2-455a-81d6-e1076ece4535 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:37.501303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4183ad-f0a2-455a-81d6-e1076ece4535 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:37.501613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4183ad-f0a2-455a-81d6-e1076ece4535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:37.503027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4183ad-f0a2-455a-81d6-e1076ece4535 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:37.526039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 211/425] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:37.532110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4183ad-f0a2-455a-81d6-e1076ece4535 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:37.641280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b2f7-11d4-4742-b29c-c27fb00faf48 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:37.685062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba564e7-7928-49bc-baf3-909bf2ae6589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:37.685949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba564e7-7928-49bc-baf3-909bf2ae6589 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:37.686848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba564e7-7928-49bc-baf3-909bf2ae6589 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:37.687870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba564e7-7928-49bc-baf3-909bf2ae6589 None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:37.694571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba564e7-7928-49bc-baf3-909bf2ae6589 None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:37.696037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba564e7-7928-49bc-baf3-909bf2ae6589 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:37.697694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 215/426] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:37 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:37.703705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba564e7-7928-49bc-baf3-909bf2ae6589 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:37.754953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4183ad-f0a2-455a-81d6-e1076ece4535 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:37.775963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:37.804240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db8619-9603-426a-8470-e3b65c5624fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:37.804777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db8619-9603-426a-8470-e3b65c5624fc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:37.805062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db8619-9603-426a-8470-e3b65c5624fc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:37.805336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db8619-9603-426a-8470-e3b65c5624fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:37.858863 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:37.902102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db8619-9603-426a-8470-e3b65c5624fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:37.904223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db8619-9603-426a-8470-e3b65c5624fc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:37.939820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba564e7-7928-49bc-baf3-909bf2ae6589 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:38.000287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c107a-e521-443f-b665-5380015b0798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:38.000969 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c107a-e521-443f-b665-5380015b0798 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:38.001248 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c107a-e521-443f-b665-5380015b0798 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:38.001521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c107a-e521-443f-b665-5380015b0798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:38.002388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c107a-e521-443f-b665-5380015b0798 None admin] RBAC: Adding query filter params (group.id=985884b9875f4d2581da91f1b3609875, role.id=ec1f98086b0748cf9d484264d6d60fff, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:38.002700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c107a-e521-443f-b665-5380015b0798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:38.004180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c107a-e521-443f-b665-5380015b0798 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:38.020930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 216/427] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Jun 16 14:41:37 2022] GET /identity/v3/role_assignments?group.id=985884b9875f4d2581da91f1b3609875&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=ec1f98086b0748cf9d484264d6d60fff => generated 611 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:38.036493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 212/428] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:38.042170 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c107a-e521-443f-b665-5380015b0798 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:38.078313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840704d3-c3a5-49cd-b61b-d56e3eb98fb2 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:38.078945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840704d3-c3a5-49cd-b61b-d56e3eb98fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:38.079372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840704d3-c3a5-49cd-b61b-d56e3eb98fb2 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:38.081280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 213/429] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:41:38.090620 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3713f67-ac68-4886-adda-35b851381193 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:38.091262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3713f67-ac68-4886-adda-35b851381193 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:38.091736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3713f67-ac68-4886-adda-35b851381193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:38.125567 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a3713f67-ac68-4886-adda-35b851381193 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:38.127378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a3713f67-ac68-4886-adda-35b851381193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:38.164692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:38.177234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c107a-e521-443f-b665-5380015b0798 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:38.219791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e99694-d7d7-4fba-9d41-3d90b645b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:38.221102 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e99694-d7d7-4fba-9d41-3d90b645b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:38.221584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e99694-d7d7-4fba-9d41-3d90b645b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:38.222083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e99694-d7d7-4fba-9d41-3d90b645b1e9 None admin] PATH_INFO: `/v3/projects/e7c9534cee7f420a9b48f192ca318f6b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:38.223504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e99694-d7d7-4fba-9d41-3d90b645b1e9 None admin] RBAC: Authorizing `identity:get_project(project_id=e7c9534cee7f420a9b48f192ca318f6b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:38.225351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e99694-d7d7-4fba-9d41-3d90b645b1e9 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:38.227581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 217/430] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:38 2022] GET /identity/v3/projects/e7c9534cee7f420a9b48f192ca318f6b => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:38.235905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e99694-d7d7-4fba-9d41-3d90b645b1e9 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:38.240551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:38.270422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 214/431] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:38.295177 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3713f67-ac68-4886-adda-35b851381193 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:38.364548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e99694-d7d7-4fba-9d41-3d90b645b1e9 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:38.412826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd305fe5-fb81-4273-9a0a-1a557bba2e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:38.414631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd305fe5-fb81-4273-9a0a-1a557bba2e4c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:38.415220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd305fe5-fb81-4273-9a0a-1a557bba2e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:38.415678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd305fe5-fb81-4273-9a0a-1a557bba2e4c None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:38.417653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd305fe5-fb81-4273-9a0a-1a557bba2e4c None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:38.419453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd305fe5-fb81-4273-9a0a-1a557bba2e4c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:38.425908 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3713f67-ac68-4886-adda-35b851381193 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:38.426584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 218/432] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:38 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:38.429480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd305fe5-fb81-4273-9a0a-1a557bba2e4c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:38.469534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99786e43-c456-4d81-8858-095141419b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:38.470333 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99786e43-c456-4d81-8858-095141419b47 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:38.470620 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99786e43-c456-4d81-8858-095141419b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:38.470951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99786e43-c456-4d81-8858-095141419b47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:38.482257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99786e43-c456-4d81-8858-095141419b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-99786e43-c456-4d81-8858-095141419b47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:38.492840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:38.493756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:38.494589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 215/433] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:41:38.500361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99786e43-c456-4d81-8858-095141419b47 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:38.515967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:38.520878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:38.560942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd305fe5-fb81-4273-9a0a-1a557bba2e4c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:38.606920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6f597-f8e8-4f93-bf20-ef765ff6e562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:38.608911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6f597-f8e8-4f93-bf20-ef765ff6e562 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:38.609377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6f597-f8e8-4f93-bf20-ef765ff6e562 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:38.609980 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6f597-f8e8-4f93-bf20-ef765ff6e562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:38.611286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6f597-f8e8-4f93-bf20-ef765ff6e562 None admin] RBAC: Adding query filter params (group.id=985884b9875f4d2581da91f1b3609875, role.id=764ea3c1356843bca6a7e706c6ba9a20, scope.project.id=e7c9534cee7f420a9b48f192ca318f6b) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:38.611996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6f597-f8e8-4f93-bf20-ef765ff6e562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:38.614080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6f597-f8e8-4f93-bf20-ef765ff6e562 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:38.616695 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99786e43-c456-4d81-8858-095141419b47 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:38.622263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 219/434] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Jun 16 14:41:38 2022] GET /identity/v3/role_assignments?group.id=985884b9875f4d2581da91f1b3609875&scope.project.id=e7c9534cee7f420a9b48f192ca318f6b&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:38.674706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f770c-f9fb-4cc6-b0ab-94ae427600e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:38.675471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f770c-f9fb-4cc6-b0ab-94ae427600e0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:38.675756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f770c-f9fb-4cc6-b0ab-94ae427600e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:38.676034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f770c-f9fb-4cc6-b0ab-94ae427600e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:38.676801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f770c-f9fb-4cc6-b0ab-94ae427600e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:38.677115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f770c-f9fb-4cc6-b0ab-94ae427600e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:38.678568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f770c-f9fb-4cc6-b0ab-94ae427600e0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:38.689411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 216/435] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:41:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:38.695194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6f597-f8e8-4f93-bf20-ef765ff6e562 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:38.799749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c834-b5d6-492c-a7fc-d04e5f460e8a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:38.800498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c834-b5d6-492c-a7fc-d04e5f460e8a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:38.801469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c834-b5d6-492c-a7fc-d04e5f460e8a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:38.803928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 217/436] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:38.809630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0efcc8-9d41-4f77-b139-474adaaf16dd None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:38.809953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0efcc8-9d41-4f77-b139-474adaaf16dd None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:38.810216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0efcc8-9d41-4f77-b139-474adaaf16dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:38.827615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6f597-f8e8-4f93-bf20-ef765ff6e562 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:38.830920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4b0efcc8-9d41-4f77-b139-474adaaf16dd None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:38.831787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4b0efcc8-9d41-4f77-b139-474adaaf16dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:38.873202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3f0e8-f56c-4479-8dba-247b137bfbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:38.873983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3f0e8-f56c-4479-8dba-247b137bfbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:38.874295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3f0e8-f56c-4479-8dba-247b137bfbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:38.874580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3f0e8-f56c-4479-8dba-247b137bfbb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:38.880017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:38.927441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:38.937702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 218/437] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:38.959596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0efcc8-9d41-4f77-b139-474adaaf16dd None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:38.966718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3f0e8-f56c-4479-8dba-247b137bfbb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:38.968957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3f0e8-f56c-4479-8dba-247b137bfbb2 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:39.086428 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0efcc8-9d41-4f77-b139-474adaaf16dd None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:39.099734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 220/438] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:39.106484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3f0e8-f56c-4479-8dba-247b137bfbb2 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:39.132202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a931e-036a-47f3-95a2-59b088166bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:39.133293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a931e-036a-47f3-95a2-59b088166bfa None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:39.133575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a931e-036a-47f3-95a2-59b088166bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:39.133850 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a931e-036a-47f3-95a2-59b088166bfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:39.146586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a931e-036a-47f3-95a2-59b088166bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b32a931e-036a-47f3-95a2-59b088166bfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:39.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:39.156550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:39.157417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 219/439] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:41:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:41:39.164658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a931e-036a-47f3-95a2-59b088166bfa None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:39.170255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:39.252218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:39.254688 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3f0e8-f56c-4479-8dba-247b137bfbb2 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:39.292819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7c88d-8501-42a0-8d58-8e8b6419c496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:39.293682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c88d-8501-42a0-8d58-8e8b6419c496 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:39.293994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c88d-8501-42a0-8d58-8e8b6419c496 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:39.294267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c88d-8501-42a0-8d58-8e8b6419c496 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:39.295439 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7c88d-8501-42a0-8d58-8e8b6419c496 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:39.297839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7c88d-8501-42a0-8d58-8e8b6419c496 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:39.299745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 221/440] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:39 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:39.300792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0b0f-8c38-42a2-9f7a-cc5c7438a45c None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:39.301108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0b0f-8c38-42a2-9f7a-cc5c7438a45c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:39.301373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0b0f-8c38-42a2-9f7a-cc5c7438a45c None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:39.302752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 222/441] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:39.305053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0b0f-8c38-42a2-9f7a-cc5c7438a45c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:39.314248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a931e-036a-47f3-95a2-59b088166bfa None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:39.355111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc80ff-8ffb-48c7-91d7-71434694f299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:39.355785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc80ff-8ffb-48c7-91d7-71434694f299 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:39.356064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc80ff-8ffb-48c7-91d7-71434694f299 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:39.356336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc80ff-8ffb-48c7-91d7-71434694f299 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:39.357076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc80ff-8ffb-48c7-91d7-71434694f299 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:39.357380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc80ff-8ffb-48c7-91d7-71434694f299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:39.359485 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc80ff-8ffb-48c7-91d7-71434694f299 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:39.367400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 220/442] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:39.368565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23172dd1-3c3d-4c98-bfa3-1be7bab50e2e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:39.368852 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23172dd1-3c3d-4c98-bfa3-1be7bab50e2e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:39.369128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23172dd1-3c3d-4c98-bfa3-1be7bab50e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:39.385654 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-23172dd1-3c3d-4c98-bfa3-1be7bab50e2e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:39.386853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-23172dd1-3c3d-4c98-bfa3-1be7bab50e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:39.412734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0b0f-8c38-42a2-9f7a-cc5c7438a45c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:39.414988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:39.449086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca4e22-4ef0-4541-9149-c9de1dedafb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:39.450259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca4e22-4ef0-4541-9149-c9de1dedafb1 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:39.450545 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca4e22-4ef0-4541-9149-c9de1dedafb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:39.450821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca4e22-4ef0-4541-9149-c9de1dedafb1 None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:39.452176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca4e22-4ef0-4541-9149-c9de1dedafb1 None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:39.453663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca4e22-4ef0-4541-9149-c9de1dedafb1 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:39.455012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 221/443] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:39.455848 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23172dd1-3c3d-4c98-bfa3-1be7bab50e2e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:39.460476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 223/444] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:39 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:39.470498 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca4e22-4ef0-4541-9149-c9de1dedafb1 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:39.509701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:39.555180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23172dd1-3c3d-4c98-bfa3-1be7bab50e2e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:39.573309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca4e22-4ef0-4541-9149-c9de1dedafb1 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:39.590348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820ef5f-f08c-4142-93d8-dedd736d419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:39.590998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820ef5f-f08c-4142-93d8-dedd736d419c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:39.591281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820ef5f-f08c-4142-93d8-dedd736d419c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:39.591555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820ef5f-f08c-4142-93d8-dedd736d419c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:39.608790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c87cd-c7d1-440e-8327-e7eec6e5c41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:39.609374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c87cd-c7d1-440e-8327-e7eec6e5c41d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:39.609655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c87cd-c7d1-440e-8327-e7eec6e5c41d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:39.610027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c87cd-c7d1-440e-8327-e7eec6e5c41d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:39.610869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c87cd-c7d1-440e-8327-e7eec6e5c41d None admin] RBAC: Adding query filter params (group.id=985884b9875f4d2581da91f1b3609875, role.id=764ea3c1356843bca6a7e706c6ba9a20, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:39.611177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c87cd-c7d1-440e-8327-e7eec6e5c41d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:39.612602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c87cd-c7d1-440e-8327-e7eec6e5c41d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:39.618448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 224/445] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Jun 16 14:41:39 2022] GET /identity/v3/role_assignments?group.id=985884b9875f4d2581da91f1b3609875&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=764ea3c1356843bca6a7e706c6ba9a20 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:39.619214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c87cd-c7d1-440e-8327-e7eec6e5c41d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:39.674478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820ef5f-f08c-4142-93d8-dedd736d419c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:39.675203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:39.677042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820ef5f-f08c-4142-93d8-dedd736d419c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:39.741276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:39.758081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c87cd-c7d1-440e-8327-e7eec6e5c41d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:39.800542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 222/446] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:39.801012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a0714-cee2-49f8-ab0b-16321961f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:39.801830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a0714-cee2-49f8-ab0b-16321961f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:39.802163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a0714-cee2-49f8-ab0b-16321961f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:39.802441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a0714-cee2-49f8-ab0b-16321961f1f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:39.808356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820ef5f-f08c-4142-93d8-dedd736d419c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:39.816560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a0714-cee2-49f8-ab0b-16321961f1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-f24a0714-cee2-49f8-ab0b-16321961f1f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:39.824377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:39.825453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:39.826475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 225/447] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:41:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:39.833319 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a0714-cee2-49f8-ab0b-16321961f1f4 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:39.943924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:39.945406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820ef5f-f08c-4142-93d8-dedd736d419c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:39.950175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a0714-cee2-49f8-ab0b-16321961f1f4 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:39.988585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6e57-b0fb-4d7c-bcf3-f9e22f275921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:39.988890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6e57-b0fb-4d7c-bcf3-f9e22f275921 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:39.989169 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6e57-b0fb-4d7c-bcf3-f9e22f275921 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:39.989441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6e57-b0fb-4d7c-bcf3-f9e22f275921 None admin] PATH_INFO: `/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:39.990652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6e57-b0fb-4d7c-bcf3-f9e22f275921 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdc2b03f47c482d8d86dbba1db20be0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:39.992093 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6e57-b0fb-4d7c-bcf3-f9e22f275921 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:39.993778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 223/448] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:39 2022] GET /identity/v3/projects/cfdc2b03f47c482d8d86dbba1db20be0 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:39.997761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae120c-bf59-4617-b292-2757ad9ace12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:39.998584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae120c-bf59-4617-b292-2757ad9ace12 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:39.998980 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae120c-bf59-4617-b292-2757ad9ace12 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:39.999262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae120c-bf59-4617-b292-2757ad9ace12 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:39.999568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6e57-b0fb-4d7c-bcf3-f9e22f275921 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:40.000025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae120c-bf59-4617-b292-2757ad9ace12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:40.000334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae120c-bf59-4617-b292-2757ad9ace12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:40.001739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae120c-bf59-4617-b292-2757ad9ace12 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:40.012781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 226/449] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:40.019098 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae120c-bf59-4617-b292-2757ad9ace12 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:40.024809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:40.104000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6e57-b0fb-4d7c-bcf3-f9e22f275921 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:40.120735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae120c-bf59-4617-b292-2757ad9ace12 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:40.136898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0bc60-e9d2-4b36-b246-f2623e13c875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:40.138047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0bc60-e9d2-4b36-b246-f2623e13c875 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:40.138327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0bc60-e9d2-4b36-b246-f2623e13c875 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:40.138598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0bc60-e9d2-4b36-b246-f2623e13c875 None admin] PATH_INFO: `/v3/groups/985884b9875f4d2581da91f1b3609875` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:40.140478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0bc60-e9d2-4b36-b246-f2623e13c875 None admin] RBAC: Authorizing `identity:get_group(group_id=985884b9875f4d2581da91f1b3609875)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:40.142094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0bc60-e9d2-4b36-b246-f2623e13c875 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:40.143720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 224/450] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:39 2022] GET /identity/v3/groups/985884b9875f4d2581da91f1b3609875 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:40.150490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0bc60-e9d2-4b36-b246-f2623e13c875 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:40.154207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f0db0-af62-4dc1-9aca-56b8e618a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:40.154864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0db0-af62-4dc1-9aca-56b8e618a7da None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:40.156202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0db0-af62-4dc1-9aca-56b8e618a7da None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:40.156475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0db0-af62-4dc1-9aca-56b8e618a7da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:40.184783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:40.226839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f0db0-af62-4dc1-9aca-56b8e618a7da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:40.228213 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f0db0-af62-4dc1-9aca-56b8e618a7da None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:40.242429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:40.255563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0bc60-e9d2-4b36-b246-f2623e13c875 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:40.292590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a592a-d770-4011-a4fd-d46a50f8484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:40.293242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a592a-d770-4011-a4fd-d46a50f8484b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:40.293525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a592a-d770-4011-a4fd-d46a50f8484b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:40.293802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a592a-d770-4011-a4fd-d46a50f8484b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:40.294955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a592a-d770-4011-a4fd-d46a50f8484b None admin] RBAC: Adding query filter params (group.id=985884b9875f4d2581da91f1b3609875, role.id=ec1f98086b0748cf9d484264d6d60fff, scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:40.295147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a592a-d770-4011-a4fd-d46a50f8484b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:40.296668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a592a-d770-4011-a4fd-d46a50f8484b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:40.302460 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 225/451] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Jun 16 14:41:40 2022] GET /identity/v3/role_assignments?group.id=985884b9875f4d2581da91f1b3609875&scope.project.id=cfdc2b03f47c482d8d86dbba1db20be0&role.id=ec1f98086b0748cf9d484264d6d60fff => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:40.334307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 227/452] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:41:40.340406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a592a-d770-4011-a4fd-d46a50f8484b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:40.450527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a592a-d770-4011-a4fd-d46a50f8484b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:40.487101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcbfc0-4136-4c0c-b791-71a8b974bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:40.488362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcbfc0-4136-4c0c-b791-71a8b974bef8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:40.488362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcbfc0-4136-4c0c-b791-71a8b974bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:40.488534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcbfc0-4136-4c0c-b791-71a8b974bef8 None admin] PATH_INFO: `/v3/projects/d4e16df5d3ec4c65bc803e3fc067e3c7` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:40.489602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcbfc0-4136-4c0c-b791-71a8b974bef8 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e16df5d3ec4c65bc803e3fc067e3c7)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:40.491111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcbfc0-4136-4c0c-b791-71a8b974bef8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:40.492796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 226/453] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:41:40 2022] GET /identity/v3/projects/d4e16df5d3ec4c65bc803e3fc067e3c7 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:40.498310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f0db0-af62-4dc1-9aca-56b8e618a7da None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:40.560413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:40.606186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f0db0-af62-4dc1-9aca-56b8e618a7da None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:40.641232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c9f9f-dd67-438c-8323-e807f51033bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:40.642125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c9f9f-dd67-438c-8323-e807f51033bb None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:40.642782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c9f9f-dd67-438c-8323-e807f51033bb None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:40.642782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c9f9f-dd67-438c-8323-e807f51033bb None admin] PATH_INFO: `/v3/groups/5454fdb2c0a7420b823743fdd5d78b9a` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:40.643876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c9f9f-dd67-438c-8323-e807f51033bb None admin] RBAC: Authorizing `identity:get_group(group_id=5454fdb2c0a7420b823743fdd5d78b9a)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:40.645470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c9f9f-dd67-438c-8323-e807f51033bb None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:40.647138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 228/454] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Jun 16 14:41:40 2022] GET /identity/v3/groups/5454fdb2c0a7420b823743fdd5d78b9a => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:40.655995 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcbfc0-4136-4c0c-b791-71a8b974bef8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:40.679914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:40.755873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcbfc0-4136-4c0c-b791-71a8b974bef8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:40.789222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62792ab-d332-43b6-a7dd-358b34e18fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:40.789862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62792ab-d332-43b6-a7dd-358b34e18fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:40.790175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62792ab-d332-43b6-a7dd-358b34e18fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:40.790449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62792ab-d332-43b6-a7dd-358b34e18fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:40.791270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62792ab-d332-43b6-a7dd-358b34e18fb3 None admin] RBAC: Adding query filter params (group.id=5454fdb2c0a7420b823743fdd5d78b9a, role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=d4e16df5d3ec4c65bc803e3fc067e3c7) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:40.791578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62792ab-d332-43b6-a7dd-358b34e18fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:40.792994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62792ab-d332-43b6-a7dd-358b34e18fb3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:40.798698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 227/455] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Jun 16 14:41:40 2022] GET /identity/v3/role_assignments?group.id=5454fdb2c0a7420b823743fdd5d78b9a&scope.project.id=d4e16df5d3ec4c65bc803e3fc067e3c7&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:43.459517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb0c2-d3ec-4309-93e2-f8a89a6e3748 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:43.460553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb0c2-d3ec-4309-93e2-f8a89a6e3748 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:43.461044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb0c2-d3ec-4309-93e2-f8a89a6e3748 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:43.462967 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 229/456] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:43.472544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb3ef5-33b9-403e-acf4-c4642bb3a6dc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:43.473506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb3ef5-33b9-403e-acf4-c4642bb3a6dc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:43.474037 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb3ef5-33b9-403e-acf4-c4642bb3a6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:43.499620 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-36eb3ef5-33b9-403e-acf4-c4642bb3a6dc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:43.501179 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-36eb3ef5-33b9-403e-acf4-c4642bb3a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:43.596523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 228/457] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:43.642309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eb0c2-d3ec-4309-93e2-f8a89a6e3748 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:43.667302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212364-7efa-4e0d-81e5-71e8fc78158a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:43.667840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212364-7efa-4e0d-81e5-71e8fc78158a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:43.668308 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212364-7efa-4e0d-81e5-71e8fc78158a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:43.670180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 229/458] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:41:43.675006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931cd61-ed43-4ed4-8f1e-c61f28f29fc0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:43.675298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931cd61-ed43-4ed4-8f1e-c61f28f29fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:43.675574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931cd61-ed43-4ed4-8f1e-c61f28f29fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:43.706491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8931cd61-ed43-4ed4-8f1e-c61f28f29fc0 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:43.716760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8931cd61-ed43-4ed4-8f1e-c61f28f29fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:43.736293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:43.848024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eb0c2-d3ec-4309-93e2-f8a89a6e3748 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:43.855040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 230/459] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:43.884548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931cd61-ed43-4ed4-8f1e-c61f28f29fc0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:43.890499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:43.909138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1bd2e-bf9a-4898-a7a0-274ff6e23530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:43.910241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bd2e-bf9a-4898-a7a0-274ff6e23530 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:43.910531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bd2e-bf9a-4898-a7a0-274ff6e23530 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:43.911273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bd2e-bf9a-4898-a7a0-274ff6e23530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:43.924446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1bd2e-bf9a-4898-a7a0-274ff6e23530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:43.925919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1bd2e-bf9a-4898-a7a0-274ff6e23530 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-b9f1bd2e-bf9a-4898-a7a0-274ff6e23530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:43.946316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:43.947253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:43.948095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:43.948095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:43.948095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:43.948095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:43.948095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 230/460] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:43.948942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97176654-c8b0-4023-87cb-7e83cc0e5644 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:43.949229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97176654-c8b0-4023-87cb-7e83cc0e5644 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:43.949509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97176654-c8b0-4023-87cb-7e83cc0e5644 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:43.950914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 231/461] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:43.956585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd2b4-461b-4a73-be42-785fc45e557b None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:43.956891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd2b4-461b-4a73-be42-785fc45e557b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:43.957170 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cd2b4-461b-4a73-be42-785fc45e557b None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:43.958789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 232/462] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:43.963553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cd2b4-461b-4a73-be42-785fc45e557b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:44.012180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931cd61-ed43-4ed4-8f1e-c61f28f29fc0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:44.049062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6352d-fc70-4a5b-b892-8f0b85bf7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:44.049866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6352d-fc70-4a5b-b892-8f0b85bf7a90 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:44.050174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6352d-fc70-4a5b-b892-8f0b85bf7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:44.050455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6352d-fc70-4a5b-b892-8f0b85bf7a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:44.066803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6352d-fc70-4a5b-b892-8f0b85bf7a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:44.068550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6352d-fc70-4a5b-b892-8f0b85bf7a90 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:44.072085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:44.079970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cd2b4-461b-4a73-be42-785fc45e557b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-acb6352d-fc70-4a5b-b892-8f0b85bf7a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:44.089513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:44.090555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:44.091591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:44.091591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:44.091591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:44.091591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:44.096206 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 231/463] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:41:44.097568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1167b1f-1088-4904-9273-9192161ab833 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:44.097857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1167b1f-1088-4904-9273-9192161ab833 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:44.098158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1167b1f-1088-4904-9273-9192161ab833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:44.115572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a1167b1f-1088-4904-9273-9192161ab833 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:44.116767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a1167b1f-1088-4904-9273-9192161ab833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:44.123153 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d639c-8a34-432a-94a5-623b016948f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:44.124548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d639c-8a34-432a-94a5-623b016948f9 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:44.125467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d639c-8a34-432a-94a5-623b016948f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:44.125929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d639c-8a34-432a-94a5-623b016948f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:44.126800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d639c-8a34-432a-94a5-623b016948f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:44.127634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d639c-8a34-432a-94a5-623b016948f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:44.129790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d639c-8a34-432a-94a5-623b016948f9 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:44.147542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 233/464] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:44.147542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281186ca-8073-414c-bbc7-9df9e39cc006 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:44.147542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281186ca-8073-414c-bbc7-9df9e39cc006 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:44.147542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281186ca-8073-414c-bbc7-9df9e39cc006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:44.164828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-281186ca-8073-414c-bbc7-9df9e39cc006 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:44.166048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-281186ca-8073-414c-bbc7-9df9e39cc006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:44.194113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 232/465] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:44.199574 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:44.213905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1167b1f-1088-4904-9273-9192161ab833 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:44.257006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 234/466] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:44.258842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281186ca-8073-414c-bbc7-9df9e39cc006 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:44.319649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1167b1f-1088-4904-9273-9192161ab833 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:44.349669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:44.360044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df122ddf-6ab3-4b76-a864-8dac0e9c2452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:44.361008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122ddf-6ab3-4b76-a864-8dac0e9c2452 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:44.361532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122ddf-6ab3-4b76-a864-8dac0e9c2452 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:44.362138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122ddf-6ab3-4b76-a864-8dac0e9c2452 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:44.363299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df122ddf-6ab3-4b76-a864-8dac0e9c2452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:44.363684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df122ddf-6ab3-4b76-a864-8dac0e9c2452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:44.365082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df122ddf-6ab3-4b76-a864-8dac0e9c2452 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:44.371469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281186ca-8073-414c-bbc7-9df9e39cc006 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:44.378461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 233/467] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:44.379552 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df122ddf-6ab3-4b76-a864-8dac0e9c2452 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:44.409414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d93670-306a-4c19-8a77-d75953fc7f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:44.410119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93670-306a-4c19-8a77-d75953fc7f5d None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:44.410397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93670-306a-4c19-8a77-d75953fc7f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:44.410771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93670-306a-4c19-8a77-d75953fc7f5d None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:44.411363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d93670-306a-4c19-8a77-d75953fc7f5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:44.413048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d93670-306a-4c19-8a77-d75953fc7f5d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:44.434132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 235/468] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:41:44 2022] POST /identity/v3/users => generated 248 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:41:44.435276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d93670-306a-4c19-8a77-d75953fc7f5d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:44.477240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:44.520274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df122ddf-6ab3-4b76-a864-8dac0e9c2452 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:44.564502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde1273-70db-4aa1-9d89-677a76f401b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:44.565730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde1273-70db-4aa1-9d89-677a76f401b9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:44.566335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde1273-70db-4aa1-9d89-677a76f401b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:44.566927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde1273-70db-4aa1-9d89-677a76f401b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:44.581215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde1273-70db-4aa1-9d89-677a76f401b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:44.583304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde1273-70db-4aa1-9d89-677a76f401b9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:44.588502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d93670-306a-4c19-8a77-d75953fc7f5d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-6cde1273-70db-4aa1-9d89-677a76f401b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:44.604779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:44.605670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:44.606544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:44.606544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:44.606544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:44.606544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:44.609151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 234/469] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:44.610414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde1273-70db-4aa1-9d89-677a76f401b9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:44.636964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85634268-869b-4faa-ba9c-58789dfddb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:44.638565 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85634268-869b-4faa-ba9c-58789dfddb42 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:44.638858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85634268-869b-4faa-ba9c-58789dfddb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:44.639134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85634268-869b-4faa-ba9c-58789dfddb42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:44.663894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:44.664439 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85634268-869b-4faa-ba9c-58789dfddb42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:44.666284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85634268-869b-4faa-ba9c-58789dfddb42 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-85634268-869b-4faa-ba9c-58789dfddb42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:44.689116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:44.690293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:44.691329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:44.691329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:44.691329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:44.691329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:44.691329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 236/470] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:44.692007 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85634268-869b-4faa-ba9c-58789dfddb42 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:44.744337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde1273-70db-4aa1-9d89-677a76f401b9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:44.784805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef3bfd-d140-48b0-81ab-1725a5f64d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:44.785509 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef3bfd-d140-48b0-81ab-1725a5f64d8c None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:44.785853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef3bfd-d140-48b0-81ab-1725a5f64d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:44.786153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef3bfd-d140-48b0-81ab-1725a5f64d8c None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:44.786846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef3bfd-d140-48b0-81ab-1725a5f64d8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:44.788347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef3bfd-d140-48b0-81ab-1725a5f64d8c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:44.792185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:44.812357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 235/471] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:41:44 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:41:44.817935 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef3bfd-d140-48b0-81ab-1725a5f64d8c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:44.838990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85634268-869b-4faa-ba9c-58789dfddb42 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:44.921911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280f4d1-121e-4f44-b5ed-bb32e14c7409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:44.922847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280f4d1-121e-4f44-b5ed-bb32e14c7409 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:44.923450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280f4d1-121e-4f44-b5ed-bb32e14c7409 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:44.925440 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280f4d1-121e-4f44-b5ed-bb32e14c7409 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:44.926397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280f4d1-121e-4f44-b5ed-bb32e14c7409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:44.927700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280f4d1-121e-4f44-b5ed-bb32e14c7409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:44.930494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280f4d1-121e-4f44-b5ed-bb32e14c7409 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:44.962367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 237/472] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:44.966893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280f4d1-121e-4f44-b5ed-bb32e14c7409 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:45.027937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:45.037612 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef3bfd-d140-48b0-81ab-1725a5f64d8c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:45.080227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f5a66-aea4-4ff6-8ee8-e3ab8c456dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:45.080901 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5a66-aea4-4ff6-8ee8-e3ab8c456dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:45.081182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5a66-aea4-4ff6-8ee8-e3ab8c456dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:45.081453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5a66-aea4-4ff6-8ee8-e3ab8c456dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:45.082210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f5a66-aea4-4ff6-8ee8-e3ab8c456dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:45.082514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f5a66-aea4-4ff6-8ee8-e3ab8c456dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:45.084253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f5a66-aea4-4ff6-8ee8-e3ab8c456dd8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:45.098949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 236/473] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:45.100475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10657c5-15e1-4511-8c67-d12df0d47eee None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:45.100885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10657c5-15e1-4511-8c67-d12df0d47eee None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:45.101263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10657c5-15e1-4511-8c67-d12df0d47eee None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:45.103539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 237/474] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:45.104434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10657c5-15e1-4511-8c67-d12df0d47eee None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:45.120626 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280f4d1-121e-4f44-b5ed-bb32e14c7409 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:45.162846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce843498-e8ce-4357-a65d-5adc8d736075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:45.165097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843498-e8ce-4357-a65d-5adc8d736075 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:45.166370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843498-e8ce-4357-a65d-5adc8d736075 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:45.166827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843498-e8ce-4357-a65d-5adc8d736075 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:45.168449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce843498-e8ce-4357-a65d-5adc8d736075 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:45.169913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce843498-e8ce-4357-a65d-5adc8d736075 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:45.178143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:45.192745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 238/475] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:41:44 2022] POST /identity/v3/users => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:41:45.198722 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6d961-e252-43d7-9144-f6458368f466 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:45.199985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6d961-e252-43d7-9144-f6458368f466 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:45.200345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6d961-e252-43d7-9144-f6458368f466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:45.225593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-42f6d961-e252-43d7-9144-f6458368f466 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:45.227673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-42f6d961-e252-43d7-9144-f6458368f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:45.238176 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10657c5-15e1-4511-8c67-d12df0d47eee None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:45.285679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc35e15-d495-4b3c-bf02-bd2939bcc781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:45.286400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc35e15-d495-4b3c-bf02-bd2939bcc781 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:45.286684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc35e15-d495-4b3c-bf02-bd2939bcc781 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:45.286979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc35e15-d495-4b3c-bf02-bd2939bcc781 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:45.287747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc35e15-d495-4b3c-bf02-bd2939bcc781 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:45.289223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc35e15-d495-4b3c-bf02-bd2939bcc781 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:45.313272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 238/476] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:41:45 2022] POST /identity/v3/users => generated 249 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:41:45.328114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 239/477] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:45.364964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc35e15-d495-4b3c-bf02-bd2939bcc781 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:45.388371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:45.499280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc35e15-d495-4b3c-bf02-bd2939bcc781 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:45.540753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf89ae-d2f9-494c-8c4e-5ccd8b60512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:45.541413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf89ae-d2f9-494c-8c4e-5ccd8b60512a None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:45.541696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf89ae-d2f9-494c-8c4e-5ccd8b60512a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:45.541999 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf89ae-d2f9-494c-8c4e-5ccd8b60512a None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:45.542742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf89ae-d2f9-494c-8c4e-5ccd8b60512a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:45.544122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf89ae-d2f9-494c-8c4e-5ccd8b60512a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:45.552931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.sql.core [None req-d6bf89ae-d2f9-494c-8c4e-5ccd8b60512a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 14:41:45.552931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 14:41:45.552931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [parameters: {'id': '1bf9f982063540f8a970c8cf10b4e4fd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 14:41:45.552931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80109) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d6bf89ae-d2f9-494c-8c4e-5ccd8b60512a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application result.read() Jun 16 14:41:45.570127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:41:45.571008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application yield resource Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise self.value Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application session.commit() Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 14:41:45.571960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.session.flush() Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application compat.raise_( Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:41:45.572805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:41:45.573671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application result.read() Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:41:45.574490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [parameters: {'id': '1bf9f982063540f8a970c8cf10b4e4fd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:45.575250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 14:41:45.578352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:45.579616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 239/478] 10.222.0.81 () {60 vars in 1131 bytes} [Thu Jun 16 14:41:45 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:45.579703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6d961-e252-43d7-9144-f6458368f466 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:45.737365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6d961-e252-43d7-9144-f6458368f466 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:45.763175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:45.782397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fab6f6-e83a-4b23-a616-8d857fe15d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:45.783320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fab6f6-e83a-4b23-a616-8d857fe15d2d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:45.783603 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fab6f6-e83a-4b23-a616-8d857fe15d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:45.783881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fab6f6-e83a-4b23-a616-8d857fe15d2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:45.794837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fab6f6-e83a-4b23-a616-8d857fe15d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-12fab6f6-e83a-4b23-a616-8d857fe15d2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:45.807457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:45.809572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:45.812860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 240/479] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:41:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:45.817916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf89ae-d2f9-494c-8c4e-5ccd8b60512a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:45.999563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:46.057665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf89ae-d2f9-494c-8c4e-5ccd8b60512a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:46.107757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd9d26-440e-43b5-a927-14bf98cd8400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:46.108957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd9d26-440e-43b5-a927-14bf98cd8400 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:46.109243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd9d26-440e-43b5-a927-14bf98cd8400 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:46.109615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd9d26-440e-43b5-a927-14bf98cd8400 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:46.110510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd9d26-440e-43b5-a927-14bf98cd8400 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:46.110827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd9d26-440e-43b5-a927-14bf98cd8400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:46.112206 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd9d26-440e-43b5-a927-14bf98cd8400 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:46.123478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 240/480] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:47.080832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774aca4-4d7f-4970-9baa-9aefacbe0d18 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:47.081320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774aca4-4d7f-4970-9baa-9aefacbe0d18 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:47.081320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774aca4-4d7f-4970-9baa-9aefacbe0d18 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:47.082966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 241/481] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:47.088010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dc72e-22e0-4b6f-9461-f80b69da5fbc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:47.088393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dc72e-22e0-4b6f-9461-f80b69da5fbc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:47.088574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dc72e-22e0-4b6f-9461-f80b69da5fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:47.110226 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-526dc72e-22e0-4b6f-9461-f80b69da5fbc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:47.111407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-526dc72e-22e0-4b6f-9461-f80b69da5fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:47.203516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 241/482] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:47.238997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774aca4-4d7f-4970-9baa-9aefacbe0d18 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:47.389368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774aca4-4d7f-4970-9baa-9aefacbe0d18 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:47.438048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0b088-14c4-4434-8e71-5713a23a6583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:47.438894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b088-14c4-4434-8e71-5713a23a6583 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:47.439185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b088-14c4-4434-8e71-5713a23a6583 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:47.439466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b088-14c4-4434-8e71-5713a23a6583 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:47.455800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0b088-14c4-4434-8e71-5713a23a6583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-cea0b088-14c4-4434-8e71-5713a23a6583 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:47.463729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:47.464584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:47.465355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 242/483] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:47.473013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dc72e-22e0-4b6f-9461-f80b69da5fbc None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:47.602283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:47.652366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dc72e-22e0-4b6f-9461-f80b69da5fbc None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:47.705283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5614-9559-4173-8199-9f0237785777 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:47.705637 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5614-9559-4173-8199-9f0237785777 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:47.705816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426c6e-2117-4b0c-b795-e7647665cb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:47.705971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5614-9559-4173-8199-9f0237785777 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:47.706566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426c6e-2117-4b0c-b795-e7647665cb9e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:47.706851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426c6e-2117-4b0c-b795-e7647665cb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:47.707122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426c6e-2117-4b0c-b795-e7647665cb9e None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:47.707557 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 243/484] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:47.711194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af426c6e-2117-4b0c-b795-e7647665cb9e None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:47.711194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af426c6e-2117-4b0c-b795-e7647665cb9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:47.711194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af426c6e-2117-4b0c-b795-e7647665cb9e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:47.712725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb3e1-7784-4236-a891-90d79518ecca None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:47.713224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb3e1-7784-4236-a891-90d79518ecca None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:47.713710 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb3e1-7784-4236-a891-90d79518ecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:47.719369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 242/485] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:41:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:47.726004 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426c6e-2117-4b0c-b795-e7647665cb9e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:47.748916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5fafb3e1-7784-4236-a891-90d79518ecca None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:47.750148 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5fafb3e1-7784-4236-a891-90d79518ecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:47.828788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:47.871937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 244/486] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:47.913569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafb3e1-7784-4236-a891-90d79518ecca None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:47.913977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426c6e-2117-4b0c-b795-e7647665cb9e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:47.945497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:47.954490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d0704-bc00-4c0e-a8c2-b8d828530c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:47.955507 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0704-bc00-4c0e-a8c2-b8d828530c96 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:47.955930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0704-bc00-4c0e-a8c2-b8d828530c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:47.956380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0704-bc00-4c0e-a8c2-b8d828530c96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:47.968492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d0704-bc00-4c0e-a8c2-b8d828530c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:47.970246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d0704-bc00-4c0e-a8c2-b8d828530c96 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-e78d0704-bc00-4c0e-a8c2-b8d828530c96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:47.988405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:47.989283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:47.990144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:47.990144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:47.990144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:47.990144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:47.992369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 243/487] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:47.997922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c56e34-c645-427c-9eaa-6c2b24333f82 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:47.998981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c56e34-c645-427c-9eaa-6c2b24333f82 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:47.999666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c56e34-c645-427c-9eaa-6c2b24333f82 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.001231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 244/488] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:48.002141 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c56e34-c645-427c-9eaa-6c2b24333f82 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:48.041930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafb3e1-7784-4236-a891-90d79518ecca None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:48.079809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6b71b-97a0-4635-abdf-38e6ab307769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:48.081015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6b71b-97a0-4635-abdf-38e6ab307769 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.082002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6b71b-97a0-4635-abdf-38e6ab307769 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.082524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6b71b-97a0-4635-abdf-38e6ab307769 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.101585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6b71b-97a0-4635-abdf-38e6ab307769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-99f6b71b-97a0-4635-abdf-38e6ab307769 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:48.113207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:48.114464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:48.115262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 245/489] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:41:48.116355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539ead-2ce9-4ee5-bf6f-9180d643d031 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.116513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539ead-2ce9-4ee5-bf6f-9180d643d031 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.116771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539ead-2ce9-4ee5-bf6f-9180d643d031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.137027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6e539ead-2ce9-4ee5-bf6f-9180d643d031 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:48.138834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6e539ead-2ce9-4ee5-bf6f-9180d643d031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:48.144673 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c56e34-c645-427c-9eaa-6c2b24333f82 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:48.170010 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:48.186294 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982e948-3a77-4eb0-8635-b21d3ae17e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:48.186960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982e948-3a77-4eb0-8635-b21d3ae17e5b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.187241 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982e948-3a77-4eb0-8635-b21d3ae17e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.187515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982e948-3a77-4eb0-8635-b21d3ae17e5b None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.188237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982e948-3a77-4eb0-8635-b21d3ae17e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:48.188816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982e948-3a77-4eb0-8635-b21d3ae17e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:48.189944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982e948-3a77-4eb0-8635-b21d3ae17e5b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:48.205950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 245/490] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:48.205950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982e948-3a77-4eb0-8635-b21d3ae17e5b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:48.218143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 246/491] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:48.219643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194c5f-a5b0-4eef-81a0-3dc40ae0dbf0 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.219927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194c5f-a5b0-4eef-81a0-3dc40ae0dbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.220291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194c5f-a5b0-4eef-81a0-3dc40ae0dbf0 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.225774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 247/492] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:48.225774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27194c5f-a5b0-4eef-81a0-3dc40ae0dbf0 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:48.263204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:48.328943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982e948-3a77-4eb0-8635-b21d3ae17e5b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:48.336368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27194c5f-a5b0-4eef-81a0-3dc40ae0dbf0 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:48.370480 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0cb7-c2bd-4056-886b-1ef4fadf68fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:48.371161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0cb7-c2bd-4056-886b-1ef4fadf68fb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.371447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0cb7-c2bd-4056-886b-1ef4fadf68fb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.371727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0cb7-c2bd-4056-886b-1ef4fadf68fb None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.372501 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0cb7-c2bd-4056-886b-1ef4fadf68fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:48.372792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0cb7-c2bd-4056-886b-1ef4fadf68fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:48.374509 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0cb7-c2bd-4056-886b-1ef4fadf68fb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:48.376961 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3492db-5eb5-4028-9afa-c8a2f72b8163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:48.378032 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3492db-5eb5-4028-9afa-c8a2f72b8163 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.378377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3492db-5eb5-4028-9afa-c8a2f72b8163 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.378668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3492db-5eb5-4028-9afa-c8a2f72b8163 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.386762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3492db-5eb5-4028-9afa-c8a2f72b8163 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:48.388021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 246/493] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:41:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:48.388630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3492db-5eb5-4028-9afa-c8a2f72b8163 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:48.390031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff0563-638f-4d78-b62a-1d98a886c78c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.390330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff0563-638f-4d78-b62a-1d98a886c78c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.391037 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff0563-638f-4d78-b62a-1d98a886c78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-ee3492db-5eb5-4028-9afa-c8a2f72b8163 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:41:48.405775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:48.406872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 248/494] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:48.407814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3492db-5eb5-4028-9afa-c8a2f72b8163 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:48.409489 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a7ff0563-638f-4d78-b62a-1d98a886c78c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:48.410694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a7ff0563-638f-4d78-b62a-1d98a886c78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:48.434768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:48.485944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 247/495] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:48.485944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff0563-638f-4d78-b62a-1d98a886c78c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:48.528406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3492db-5eb5-4028-9afa-c8a2f72b8163 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:48.532541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:48.566784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3be0cd-6058-4765-a5b4-1ac6be8c6692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:48.567677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3be0cd-6058-4765-a5b4-1ac6be8c6692 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.567962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3be0cd-6058-4765-a5b4-1ac6be8c6692 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.568224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3be0cd-6058-4765-a5b4-1ac6be8c6692 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.579738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3be0cd-6058-4765-a5b4-1ac6be8c6692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-4e3be0cd-6058-4765-a5b4-1ac6be8c6692 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:48.587463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:48.588338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:48.589143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 249/496] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:48.590539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3be0cd-6058-4765-a5b4-1ac6be8c6692 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:48.618241 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff0563-638f-4d78-b62a-1d98a886c78c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:48.654860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e5a60-55c5-4154-8275-9ee713be887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:48.655844 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e5a60-55c5-4154-8275-9ee713be887f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.656129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e5a60-55c5-4154-8275-9ee713be887f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.656394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e5a60-55c5-4154-8275-9ee713be887f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.667564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e5a60-55c5-4154-8275-9ee713be887f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:48.669017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e5a60-55c5-4154-8275-9ee713be887f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:48.686740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-151e5a60-55c5-4154-8275-9ee713be887f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:48.688238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:48.689388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:48.694878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:48.694878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:48.694878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:48.694878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:48.694878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 248/497] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:48.694878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e5a60-55c5-4154-8275-9ee713be887f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:48.713856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3be0cd-6058-4765-a5b4-1ac6be8c6692 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:48.749939 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc102e4-4f36-45d2-83be-aa55bb6a8ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:48.750633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc102e4-4f36-45d2-83be-aa55bb6a8ccb None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.750917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc102e4-4f36-45d2-83be-aa55bb6a8ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.751198 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc102e4-4f36-45d2-83be-aa55bb6a8ccb None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.752038 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc102e4-4f36-45d2-83be-aa55bb6a8ccb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:48.752351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc102e4-4f36-45d2-83be-aa55bb6a8ccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:48.753814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc102e4-4f36-45d2-83be-aa55bb6a8ccb None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:48.782556 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:48.792789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 250/498] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Jun 16 14:41:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:48.793601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc102e4-4f36-45d2-83be-aa55bb6a8ccb None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:48.805796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e5a60-55c5-4154-8275-9ee713be887f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:48.845437 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce950d2e-4f17-42c0-83dc-41c629922e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:48.846284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce950d2e-4f17-42c0-83dc-41c629922e6f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.846566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce950d2e-4f17-42c0-83dc-41c629922e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.846838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce950d2e-4f17-42c0-83dc-41c629922e6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.858669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce950d2e-4f17-42c0-83dc-41c629922e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ce950d2e-4f17-42c0-83dc-41c629922e6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:48.866511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:48.867369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:48.868157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 249/499] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:48.868830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce950d2e-4f17-42c0-83dc-41c629922e6f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:48.910638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc102e4-4f36-45d2-83be-aa55bb6a8ccb None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:48.945003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1844e0-96ef-4e5e-a5f7-77c3e368b0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:48.945595 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1844e0-96ef-4e5e-a5f7-77c3e368b0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:48.945898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1844e0-96ef-4e5e-a5f7-77c3e368b0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:48.946186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1844e0-96ef-4e5e-a5f7-77c3e368b0e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:48.946927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1844e0-96ef-4e5e-a5f7-77c3e368b0e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:48.947233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1844e0-96ef-4e5e-a5f7-77c3e368b0e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:48.948618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1844e0-96ef-4e5e-a5f7-77c3e368b0e9 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:48.961117 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 251/500] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:41:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:48.961117 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1844e0-96ef-4e5e-a5f7-77c3e368b0e9 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:48.961117 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:48.978723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce950d2e-4f17-42c0-83dc-41c629922e6f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:49.011998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3747-ae6a-4541-ba8d-44571d5975a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:49.012914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3747-ae6a-4541-ba8d-44571d5975a5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.013194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3747-ae6a-4541-ba8d-44571d5975a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.013468 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3747-ae6a-4541-ba8d-44571d5975a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.014859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec3747-ae6a-4541-ba8d-44571d5975a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:49.015185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec3747-ae6a-4541-ba8d-44571d5975a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:49.016549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec3747-ae6a-4541-ba8d-44571d5975a5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:49.028060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 250/501] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:49.029086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3747-ae6a-4541-ba8d-44571d5975a5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:49.033512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:49.064211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1844e0-96ef-4e5e-a5f7-77c3e368b0e9 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:49.098784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef402e-3d41-41fc-8a25-af3f8a8b3d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:49.099442 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef402e-3d41-41fc-8a25-af3f8a8b3d6e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.099714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef402e-3d41-41fc-8a25-af3f8a8b3d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.099986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef402e-3d41-41fc-8a25-af3f8a8b3d6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.129602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3747-ae6a-4541-ba8d-44571d5975a5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:49.164187 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30855294-173a-453d-a865-697c4c154e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:49.164855 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30855294-173a-453d-a865-697c4c154e9d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.165143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30855294-173a-453d-a865-697c4c154e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.165421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30855294-173a-453d-a865-697c4c154e9d None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.166197 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30855294-173a-453d-a865-697c4c154e9d None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:49.166506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30855294-173a-453d-a865-697c4c154e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:49.167125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef402e-3d41-41fc-8a25-af3f8a8b3d6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:49.167880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30855294-173a-453d-a865-697c4c154e9d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:49.168557 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef402e-3d41-41fc-8a25-af3f8a8b3d6e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:49.170438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:49.176262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 251/502] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:41:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:49.177653 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240bb75-2569-47be-b4a4-9f82ffc96d6f None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.177981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240bb75-2569-47be-b4a4-9f82ffc96d6f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.178263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240bb75-2569-47be-b4a4-9f82ffc96d6f None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.179484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 252/503] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:49.180180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240bb75-2569-47be-b4a4-9f82ffc96d6f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:49.247370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:49.276267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 252/504] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:49.277115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef402e-3d41-41fc-8a25-af3f8a8b3d6e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:49.292082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240bb75-2569-47be-b4a4-9f82ffc96d6f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:49.328636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e0c0a-5aed-4406-901d-5c78680f6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:49.329429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e0c0a-5aed-4406-901d-5c78680f6416 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.329712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e0c0a-5aed-4406-901d-5c78680f6416 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.330022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e0c0a-5aed-4406-901d-5c78680f6416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.340306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e0c0a-5aed-4406-901d-5c78680f6416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:49.341784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e0c0a-5aed-4406-901d-5c78680f6416 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-639e0c0a-5aed-4406-901d-5c78680f6416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:49.360272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:49.361687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:49.362689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:49.362689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:49.362689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:49.362689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:49.362689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 253/505] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:49.362689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e0c0a-5aed-4406-901d-5c78680f6416 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:49.381203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef402e-3d41-41fc-8a25-af3f8a8b3d6e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:49.382773 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:49.418031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d78fb-5499-4886-8a32-a6bd0f8d5511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:49.418836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d78fb-5499-4886-8a32-a6bd0f8d5511 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.419096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d78fb-5499-4886-8a32-a6bd0f8d5511 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.419366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d78fb-5499-4886-8a32-a6bd0f8d5511 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.426423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d78fb-5499-4886-8a32-a6bd0f8d5511 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:49.427871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d78fb-5499-4886-8a32-a6bd0f8d5511 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-b27d78fb-5499-4886-8a32-a6bd0f8d5511 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:41:49.442433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:49.443364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:49.444479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:49.444479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:49.444479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:41:49.444479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:41:49.444479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:41:49.444479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:41:49.444479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:41:49.444479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:41:49.444479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:41:49.444479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:49.444479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 253/506] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:49.445210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1b8fb-e382-4850-9742-31b6f606edc0 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.445210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1b8fb-e382-4850-9742-31b6f606edc0 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.445326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1b8fb-e382-4850-9742-31b6f606edc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.461264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-23b1b8fb-e382-4850-9742-31b6f606edc0 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:49.462503 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-23b1b8fb-e382-4850-9742-31b6f606edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:49.469453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e0c0a-5aed-4406-901d-5c78680f6416 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:49.487426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:49.504403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60124f-277c-4a74-8c81-0a122e9f9af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:49.505137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60124f-277c-4a74-8c81-0a122e9f9af6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.505421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60124f-277c-4a74-8c81-0a122e9f9af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.505700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60124f-277c-4a74-8c81-0a122e9f9af6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.516951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60124f-277c-4a74-8c81-0a122e9f9af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:49.518446 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60124f-277c-4a74-8c81-0a122e9f9af6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:49.531245 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 254/507] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:49.532082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1b8fb-e382-4850-9742-31b6f606edc0 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ed60124f-277c-4a74-8c81-0a122e9f9af6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:49.536078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:49.537062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:49.538035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:49.538035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:49.538035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:49.538035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:49.538035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 254/508] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:49.538312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60124f-277c-4a74-8c81-0a122e9f9af6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:49.628062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:49.637379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1b8fb-e382-4850-9742-31b6f606edc0 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:49.644127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60124f-277c-4a74-8c81-0a122e9f9af6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:49.673260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7c9d8-3270-454a-a24e-475263ee87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:49.674091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c9d8-3270-454a-a24e-475263ee87e4 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.674374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c9d8-3270-454a-a24e-475263ee87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.674652 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c9d8-3270-454a-a24e-475263ee87e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.682131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111733c5-bd50-4a65-b91c-a143089955c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:49.682804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111733c5-bd50-4a65-b91c-a143089955c7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.683087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111733c5-bd50-4a65-b91c-a143089955c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.683364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111733c5-bd50-4a65-b91c-a143089955c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.684107 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111733c5-bd50-4a65-b91c-a143089955c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:49.684417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111733c5-bd50-4a65-b91c-a143089955c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:49.684715 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7c9d8-3270-454a-a24e-475263ee87e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:49.685778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111733c5-bd50-4a65-b91c-a143089955c7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:49.686403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7c9d8-3270-454a-a24e-475263ee87e4 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:49.697600 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 255/509] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:49.698427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111733c5-bd50-4a65-b91c-a143089955c7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-32d7c9d8-3270-454a-a24e-475263ee87e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:49.704054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:49.704898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:49.705735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:49.705735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:49.705735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:49.705735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:49.705735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 255/510] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:49.706155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7c9d8-3270-454a-a24e-475263ee87e4 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:49.729804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:49.800794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111733c5-bd50-4a65-b91c-a143089955c7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:49.816672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7c9d8-3270-454a-a24e-475263ee87e4 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:49.835264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c8fd5-d121-4e04-ae21-0000394c63d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:49.835933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c8fd5-d121-4e04-ae21-0000394c63d5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.836217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c8fd5-d121-4e04-ae21-0000394c63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.836492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c8fd5-d121-4e04-ae21-0000394c63d5 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.837322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c8fd5-d121-4e04-ae21-0000394c63d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:49.837638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c8fd5-d121-4e04-ae21-0000394c63d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:49.839095 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c8fd5-d121-4e04-ae21-0000394c63d5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:49.851840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18f770-1977-4b1c-b2e4-2340f209d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:49.852502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f770-1977-4b1c-b2e4-2340f209d5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:49.852785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f770-1977-4b1c-b2e4-2340f209d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:49.853059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f770-1977-4b1c-b2e4-2340f209d5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:49.853804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18f770-1977-4b1c-b2e4-2340f209d5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:49.854142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18f770-1977-4b1c-b2e4-2340f209d5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:49.855499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18f770-1977-4b1c-b2e4-2340f209d5a9 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:49.866703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 256/511] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:49.867504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18f770-1977-4b1c-b2e4-2340f209d5a9 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:49.871760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:49.876924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 256/512] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Jun 16 14:41:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:49.877332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c8fd5-d121-4e04-ae21-0000394c63d5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:49.966327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:49.973158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18f770-1977-4b1c-b2e4-2340f209d5a9 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:49.979324 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c8fd5-d121-4e04-ae21-0000394c63d5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:50.006457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48d482-897e-4d11-b722-f98765e9763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:50.007276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d482-897e-4d11-b722-f98765e9763a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:50.007553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d482-897e-4d11-b722-f98765e9763a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:50.007827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d482-897e-4d11-b722-f98765e9763a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:50.013298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb9d1b-f88c-4e73-b45b-c230a9f61490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:50.014636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9d1b-f88c-4e73-b45b-c230a9f61490 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:50.014928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9d1b-f88c-4e73-b45b-c230a9f61490 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:50.015202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9d1b-f88c-4e73-b45b-c230a9f61490 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:50.019340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48d482-897e-4d11-b722-f98765e9763a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:50.020793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48d482-897e-4d11-b722-f98765e9763a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:50.022241 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb9d1b-f88c-4e73-b45b-c230a9f61490 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:50.023680 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb9d1b-f88c-4e73-b45b-c230a9f61490 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-4e48d482-897e-4d11-b722-f98765e9763a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:50.038242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:50.039235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:50.045812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:50.045812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:50.045812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:50.045812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-fffb9d1b-f88c-4e73-b45b-c230a9f61490 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:41:50.046082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:50.046890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:50.047781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:50.047781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:50.047781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:41:50.047781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:41:50.047781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:41:50.047781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:41:50.047781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:41:50.047781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:41:50.047781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:41:50.047781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:50.048272 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 257/513] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:50.048272 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48d482-897e-4d11-b722-f98765e9763a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:50.048397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 257/514] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Jun 16 14:41:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:50.048397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb9d1b-f88c-4e73-b45b-c230a9f61490 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:50.102182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:50.148440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb9d1b-f88c-4e73-b45b-c230a9f61490 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:50.149408 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48d482-897e-4d11-b722-f98765e9763a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:50.183820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aac67c-b8b3-487c-a798-f7179a18b9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:50.184511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac67c-b8b3-487c-a798-f7179a18b9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:50.184795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac67c-b8b3-487c-a798-f7179a18b9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:50.185078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac67c-b8b3-487c-a798-f7179a18b9e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:50.185792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aac67c-b8b3-487c-a798-f7179a18b9e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:50.186178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aac67c-b8b3-487c-a798-f7179a18b9e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:50.187573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aac67c-b8b3-487c-a798-f7179a18b9e6 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:50.189838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f500b-c4f5-449f-821d-b0c04d338697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:50.190665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f500b-c4f5-449f-821d-b0c04d338697 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:50.190948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f500b-c4f5-449f-821d-b0c04d338697 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:50.191224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f500b-c4f5-449f-821d-b0c04d338697 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:50.198319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f500b-c4f5-449f-821d-b0c04d338697 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:50.199432 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 258/515] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:50.199803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f500b-c4f5-449f-821d-b0c04d338697 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:50.200064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aac67c-b8b3-487c-a798-f7179a18b9e6 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3a4f500b-c4f5-449f-821d-b0c04d338697 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:41:50.215267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:50.216266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:50.217621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:50.217621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:50.217621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:41:50.217621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:41:50.217621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:41:50.217621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:41:50.217621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:41:50.217621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:41:50.217621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:41:50.217621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:50.217621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 258/516] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:50.218278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f500b-c4f5-449f-821d-b0c04d338697 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:50.228558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:50.308619 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aac67c-b8b3-487c-a798-f7179a18b9e6 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:50.318067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f500b-c4f5-449f-821d-b0c04d338697 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:50.325629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:50.344744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b0f8-49a6-4a22-a4c9-fb06cefcd7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:50.345390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b0f8-49a6-4a22-a4c9-fb06cefcd7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:50.345669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b0f8-49a6-4a22-a4c9-fb06cefcd7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:50.345983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b0f8-49a6-4a22-a4c9-fb06cefcd7e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:50.353829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d320a-be17-4097-a79f-fbea62f7d529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:50.354910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d320a-be17-4097-a79f-fbea62f7d529 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:50.355192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d320a-be17-4097-a79f-fbea62f7d529 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:50.355468 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d320a-be17-4097-a79f-fbea62f7d529 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:50.356539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d320a-be17-4097-a79f-fbea62f7d529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:50.356860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d320a-be17-4097-a79f-fbea62f7d529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:50.358749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d320a-be17-4097-a79f-fbea62f7d529 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:50.370537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 259/517] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:50.371246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d320a-be17-4097-a79f-fbea62f7d529 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:50.417151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23b0f8-49a6-4a22-a4c9-fb06cefcd7e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:50.418726 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23b0f8-49a6-4a22-a4c9-fb06cefcd7e5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:50.435355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:50.472988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d320a-be17-4097-a79f-fbea62f7d529 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:50.519297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cd2f1-bdb1-479e-a576-72719d9943a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:50.520007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd2f1-bdb1-479e-a576-72719d9943a4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:50.520292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd2f1-bdb1-479e-a576-72719d9943a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:50.520565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd2f1-bdb1-479e-a576-72719d9943a4 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:50.521397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cd2f1-bdb1-479e-a576-72719d9943a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:50.521705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cd2f1-bdb1-479e-a576-72719d9943a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:50.523181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cd2f1-bdb1-479e-a576-72719d9943a4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:50.523757 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 259/518] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:50.524584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b0f8-49a6-4a22-a4c9-fb06cefcd7e5 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:50.542760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:50.545776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 260/519] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Jun 16 14:41:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:50.546704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cd2f1-bdb1-479e-a576-72719d9943a4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:50.626930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b0f8-49a6-4a22-a4c9-fb06cefcd7e5 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:50.645853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cd2f1-bdb1-479e-a576-72719d9943a4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:50.661323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac254-3725-4237-aa61-dc5dff6af2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:50.661986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac254-3725-4237-aa61-dc5dff6af2fc None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:50.662271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac254-3725-4237-aa61-dc5dff6af2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:50.662547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac254-3725-4237-aa61-dc5dff6af2fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:50.669311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac254-3725-4237-aa61-dc5dff6af2fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:50.671421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac254-3725-4237-aa61-dc5dff6af2fc None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:50.676297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:50.684685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71e658-8a71-479e-9c04-287996894d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:50.685354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e658-8a71-479e-9c04-287996894d3b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:50.685631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e658-8a71-479e-9c04-287996894d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:50.685978 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e658-8a71-479e-9c04-287996894d3b None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-303ac254-3725-4237-aa61-dc5dff6af2fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:41:50.686544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:50.687464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:50.688308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:41:50.688308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:41:50.688308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:41:50.688308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:41:50.688308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:41:50.688308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:41:50.688308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:50.688308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:50.689317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71e658-8a71-479e-9c04-287996894d3b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:50.689317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71e658-8a71-479e-9c04-287996894d3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:50.689599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 260/520] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:50.689733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71e658-8a71-479e-9c04-287996894d3b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:50.689846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac254-3725-4237-aa61-dc5dff6af2fc None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:50.706093 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 261/521] 10.222.0.81 () {56 vars in 1139 bytes} [Thu Jun 16 14:41:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:50.706912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71e658-8a71-479e-9c04-287996894d3b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:50.767851 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:50.792716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac254-3725-4237-aa61-dc5dff6af2fc None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:50.805333 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71e658-8a71-479e-9c04-287996894d3b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:50.829434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ec4b6-7826-45fb-8811-d48f4c648433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:50.830596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ec4b6-7826-45fb-8811-d48f4c648433 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:50.831071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ec4b6-7826-45fb-8811-d48f4c648433 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:50.831577 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ec4b6-7826-45fb-8811-d48f4c648433 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:50.832730 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ec4b6-7826-45fb-8811-d48f4c648433 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:50.834584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ec4b6-7826-45fb-8811-d48f4c648433 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:50.840508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5ab4-847f-4f71-a952-f3c862b7116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:50.841306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5ab4-847f-4f71-a952-f3c862b7116e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:50.841584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5ab4-847f-4f71-a952-f3c862b7116e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:50.841856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5ab4-847f-4f71-a952-f3c862b7116e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:50.853597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc5ab4-847f-4f71-a952-f3c862b7116e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:50.854920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 261/522] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:41:50 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:41:50.855101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc5ab4-847f-4f71-a952-f3c862b7116e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:50.855746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ec4b6-7826-45fb-8811-d48f4c648433 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-c8bc5ab4-847f-4f71-a952-f3c862b7116e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:50.892650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:50.893572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:50.894444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:50.894444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:50.894444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:50.894444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:50.894444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 262/523] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:50.894722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5ab4-847f-4f71-a952-f3c862b7116e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:50.936658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:50.979986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ec4b6-7826-45fb-8811-d48f4c648433 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:51.012930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5ab4-847f-4f71-a952-f3c862b7116e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:51.014754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:51.022702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809598c3-ce32-44c4-94dc-7b735688fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:51.023360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809598c3-ce32-44c4-94dc-7b735688fc30 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:51.023640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809598c3-ce32-44c4-94dc-7b735688fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:51.023912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809598c3-ce32-44c4-94dc-7b735688fc30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:51.057709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a3df2-0b41-4b12-bbfc-618ca9a7b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:51.058814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a3df2-0b41-4b12-bbfc-618ca9a7b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:51.058814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a3df2-0b41-4b12-bbfc-618ca9a7b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:51.058980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a3df2-0b41-4b12-bbfc-618ca9a7b3f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:51.059720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a3df2-0b41-4b12-bbfc-618ca9a7b3f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:51.060033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a3df2-0b41-4b12-bbfc-618ca9a7b3f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:51.062014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a3df2-0b41-4b12-bbfc-618ca9a7b3f9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:51.081989 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 263/524] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:51.082688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a3df2-0b41-4b12-bbfc-618ca9a7b3f9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:51.111077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809598c3-ce32-44c4-94dc-7b735688fc30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:51.113284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809598c3-ce32-44c4-94dc-7b735688fc30 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:51.182113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:51.189635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a3df2-0b41-4b12-bbfc-618ca9a7b3f9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:51.227638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e3550-1661-4940-8085-aa210ff5d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:51.229064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3550-1661-4940-8085-aa210ff5d83b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:51.229717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3550-1661-4940-8085-aa210ff5d83b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:51.230210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3550-1661-4940-8085-aa210ff5d83b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:51.234276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 262/525] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:51.235078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809598c3-ce32-44c4-94dc-7b735688fc30 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:51.271477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:51.308538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e3550-1661-4940-8085-aa210ff5d83b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:51.310031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e3550-1661-4940-8085-aa210ff5d83b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:51.349445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809598c3-ce32-44c4-94dc-7b735688fc30 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:51.386347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed49bf-d0b2-4a4e-ab10-fd8be80d3188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:51.387133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed49bf-d0b2-4a4e-ab10-fd8be80d3188 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:51.387666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed49bf-d0b2-4a4e-ab10-fd8be80d3188 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:51.387945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed49bf-d0b2-4a4e-ab10-fd8be80d3188 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:51.388669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed49bf-d0b2-4a4e-ab10-fd8be80d3188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:51.389526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed49bf-d0b2-4a4e-ab10-fd8be80d3188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:51.390949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed49bf-d0b2-4a4e-ab10-fd8be80d3188 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:51.402571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 263/526] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:51.403398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed49bf-d0b2-4a4e-ab10-fd8be80d3188 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:51.420561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:51.432319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 264/527] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:51.432319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e3550-1661-4940-8085-aa210ff5d83b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:51.515033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:51.525469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed49bf-d0b2-4a4e-ab10-fd8be80d3188 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:51.533423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e3550-1661-4940-8085-aa210ff5d83b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:51.560348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8d600-808a-4789-be5c-20723d594a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:51.561048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8d600-808a-4789-be5c-20723d594a22 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:51.561334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8d600-808a-4789-be5c-20723d594a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:51.561614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8d600-808a-4789-be5c-20723d594a22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:51.562530 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8d600-808a-4789-be5c-20723d594a22 None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=cb9c1cc51e544c90a629feb312a80c71) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:51.562848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8d600-808a-4789-be5c-20723d594a22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:51.564323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8d600-808a-4789-be5c-20723d594a22 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:51.570096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 264/528] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:51 2022] GET /identity/v3/role_assignments?user.id=cb9c1cc51e544c90a629feb312a80c71&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:51.570880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8d600-808a-4789-be5c-20723d594a22 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:51.579168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4811e-96bd-4127-a00c-e316f419216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:51.580272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4811e-96bd-4127-a00c-e316f419216f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:51.580754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4811e-96bd-4127-a00c-e316f419216f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:51.581229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4811e-96bd-4127-a00c-e316f419216f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:51.594504 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4811e-96bd-4127-a00c-e316f419216f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:51.596340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4811e-96bd-4127-a00c-e316f419216f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-19c4811e-96bd-4127-a00c-e316f419216f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:51.617285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:51.618386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:51.619407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:51.619407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:51.619407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:51.619407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:51.620974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 265/529] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:51.621934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4811e-96bd-4127-a00c-e316f419216f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:51.682853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:51.731111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8d600-808a-4789-be5c-20723d594a22 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:51.749621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4811e-96bd-4127-a00c-e316f419216f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:51.772836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64163112-b38c-4498-9542-51f8304eb62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:51.773877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64163112-b38c-4498-9542-51f8304eb62a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:51.774900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64163112-b38c-4498-9542-51f8304eb62a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:51.775381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64163112-b38c-4498-9542-51f8304eb62a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:51.785708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64163112-b38c-4498-9542-51f8304eb62a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:51.788075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64163112-b38c-4498-9542-51f8304eb62a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:51.792709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d8a0d-55ae-403d-a51b-e405249998a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:51.793518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8a0d-55ae-403d-a51b-e405249998a2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:51.793800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8a0d-55ae-403d-a51b-e405249998a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:51.794151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8a0d-55ae-403d-a51b-e405249998a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-64163112-b38c-4498-9542-51f8304eb62a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:41:51.804436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:51.805580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:51.806509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:41:51.806509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:41:51.806509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:41:51.806509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:41:51.806509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:41:51.806509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:41:51.806509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:51.806509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:51.806917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d8a0d-55ae-403d-a51b-e405249998a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:51.806917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d8a0d-55ae-403d-a51b-e405249998a2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:51.812081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 265/530] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:51.813146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64163112-b38c-4498-9542-51f8304eb62a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d23d8a0d-55ae-403d-a51b-e405249998a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:51.828433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:51.829411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:51.830619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:51.830619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:51.830619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:51.830619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:51.834041 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 266/531] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:51.834976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d8a0d-55ae-403d-a51b-e405249998a2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:51.838558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:51.931377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64163112-b38c-4498-9542-51f8304eb62a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:51.947886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:51.952688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d8a0d-55ae-403d-a51b-e405249998a2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:51.969562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f68ae2-9f6f-4168-ab61-618350e6f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:51.970304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f68ae2-9f6f-4168-ab61-618350e6f981 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:51.970555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f68ae2-9f6f-4168-ab61-618350e6f981 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:51.970836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f68ae2-9f6f-4168-ab61-618350e6f981 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:51.971563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f68ae2-9f6f-4168-ab61-618350e6f981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:51.971871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f68ae2-9f6f-4168-ab61-618350e6f981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:51.973250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f68ae2-9f6f-4168-ab61-618350e6f981 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:51.987072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 266/532] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:51.990818 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f68ae2-9f6f-4168-ab61-618350e6f981 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:51.994949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e5b22-ecc7-487e-9bbf-4791d17bdc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:51.995888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e5b22-ecc7-487e-9bbf-4791d17bdc29 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:51.996372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e5b22-ecc7-487e-9bbf-4791d17bdc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:51.996864 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e5b22-ecc7-487e-9bbf-4791d17bdc29 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:51.997853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e5b22-ecc7-487e-9bbf-4791d17bdc29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:51.998982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e5b22-ecc7-487e-9bbf-4791d17bdc29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:52.000720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e5b22-ecc7-487e-9bbf-4791d17bdc29 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:52.013848 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 267/533] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:52.015014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e5b22-ecc7-487e-9bbf-4791d17bdc29 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:52.078135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:52.111984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f68ae2-9f6f-4168-ab61-618350e6f981 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:52.132303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e5b22-ecc7-487e-9bbf-4791d17bdc29 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:52.153908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dcad6-7190-4be4-bd77-605f80edaf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:52.155057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dcad6-7190-4be4-bd77-605f80edaf16 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:52.155392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dcad6-7190-4be4-bd77-605f80edaf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:52.156084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dcad6-7190-4be4-bd77-605f80edaf16 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:52.156789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dcad6-7190-4be4-bd77-605f80edaf16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:52.157103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dcad6-7190-4be4-bd77-605f80edaf16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:52.158652 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dcad6-7190-4be4-bd77-605f80edaf16 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:52.178679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5a051-66c8-49c9-b832-41a33cd4805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:52.180041 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5a051-66c8-49c9-b832-41a33cd4805d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:52.180539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5a051-66c8-49c9-b832-41a33cd4805d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:52.181025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5a051-66c8-49c9-b832-41a33cd4805d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:52.182579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 267/534] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:52.183589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dcad6-7190-4be4-bd77-605f80edaf16 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:52.195611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5a051-66c8-49c9-b832-41a33cd4805d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:52.199134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5a051-66c8-49c9-b832-41a33cd4805d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-23c5a051-66c8-49c9-b832-41a33cd4805d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:41:52.224431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:52.225325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:52.226190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:41:52.226190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:41:52.226190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:41:52.226190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:41:52.226190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:41:52.226190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:41:52.226190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:52.226190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:52.226595 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 268/535] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:52.229912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5a051-66c8-49c9-b832-41a33cd4805d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:52.259247 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:52.322284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dcad6-7190-4be4-bd77-605f80edaf16 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:52.348474 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5a051-66c8-49c9-b832-41a33cd4805d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:52.361728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925de471-2c74-4451-ae26-de0856a0d21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:52.362426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925de471-2c74-4451-ae26-de0856a0d21a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:52.362703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925de471-2c74-4451-ae26-de0856a0d21a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:52.362981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925de471-2c74-4451-ae26-de0856a0d21a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:52.363803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925de471-2c74-4451-ae26-de0856a0d21a None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=c41347251cac48c3a2ee7fa6d2fe4cbb) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:52.364116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925de471-2c74-4451-ae26-de0856a0d21a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:52.365564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925de471-2c74-4451-ae26-de0856a0d21a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:52.368583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:52.372689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 268/536] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:52 2022] GET /identity/v3/role_assignments?user.id=c41347251cac48c3a2ee7fa6d2fe4cbb&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:52.374382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925de471-2c74-4451-ae26-de0856a0d21a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:52.390978 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18768c-4dfb-4462-bde4-8da15e67196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:52.392099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18768c-4dfb-4462-bde4-8da15e67196e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:52.392531 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18768c-4dfb-4462-bde4-8da15e67196e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:52.392967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18768c-4dfb-4462-bde4-8da15e67196e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:52.400832 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18768c-4dfb-4462-bde4-8da15e67196e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:52.402563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18768c-4dfb-4462-bde4-8da15e67196e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-9a18768c-4dfb-4462-bde4-8da15e67196e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:41:52.418789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:52.419898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:52.421390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:41:52.421390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:41:52.421390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:41:52.421390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:41:52.421390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:41:52.421390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:41:52.421390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:52.421390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:52.423708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 269/537] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:52.429432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18768c-4dfb-4462-bde4-8da15e67196e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:52.492193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925de471-2c74-4451-ae26-de0856a0d21a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:52.521408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:52.546510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18768c-4dfb-4462-bde4-8da15e67196e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:52.586551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2bb80-f700-4f73-ba03-07f67be08ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:52.586759 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43542177-c852-4a41-9814-352d9a1f333f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:52.587314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43542177-c852-4a41-9814-352d9a1f333f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:52.587600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43542177-c852-4a41-9814-352d9a1f333f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:52.587879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43542177-c852-4a41-9814-352d9a1f333f None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:52.588368 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2bb80-f700-4f73-ba03-07f67be08ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:52.588686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43542177-c852-4a41-9814-352d9a1f333f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:52.589001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43542177-c852-4a41-9814-352d9a1f333f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:52.589240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2bb80-f700-4f73-ba03-07f67be08ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:52.589712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2bb80-f700-4f73-ba03-07f67be08ae0 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:52.590483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43542177-c852-4a41-9814-352d9a1f333f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:52.590942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2bb80-f700-4f73-ba03-07f67be08ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:52.591449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2bb80-f700-4f73-ba03-07f67be08ae0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:52.593719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2bb80-f700-4f73-ba03-07f67be08ae0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:52.608667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 270/538] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:52.614952 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2bb80-f700-4f73-ba03-07f67be08ae0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:52.626650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 269/539] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:52.633929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43542177-c852-4a41-9814-352d9a1f333f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:52.711767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:52.763015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43542177-c852-4a41-9814-352d9a1f333f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:52.806038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2bb80-f700-4f73-ba03-07f67be08ae0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:52.817346 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff4138-71a8-435c-9df2-8c2a0711f146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:52.818053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff4138-71a8-435c-9df2-8c2a0711f146 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:52.818339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff4138-71a8-435c-9df2-8c2a0711f146 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:52.818615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff4138-71a8-435c-9df2-8c2a0711f146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:52.819451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff4138-71a8-435c-9df2-8c2a0711f146 None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=f2faa046b0294a0ba1090be84bb1cebc) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:52.819767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff4138-71a8-435c-9df2-8c2a0711f146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:52.821211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff4138-71a8-435c-9df2-8c2a0711f146 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:52.833597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 270/540] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:52 2022] GET /identity/v3/role_assignments?user.id=f2faa046b0294a0ba1090be84bb1cebc&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:52.854301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407cd69-09c3-44ac-99c0-1251798178d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:52.854985 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407cd69-09c3-44ac-99c0-1251798178d3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:52.855270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407cd69-09c3-44ac-99c0-1251798178d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:52.855548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407cd69-09c3-44ac-99c0-1251798178d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:52.856403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407cd69-09c3-44ac-99c0-1251798178d3 None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=8940bddd49534f01a8b1bf1dee644216) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:52.856717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407cd69-09c3-44ac-99c0-1251798178d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:52.859154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407cd69-09c3-44ac-99c0-1251798178d3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:52.866064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 271/541] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:52 2022] GET /identity/v3/role_assignments?user.id=8940bddd49534f01a8b1bf1dee644216&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:53.329284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45dd4-7f42-48bd-a0e2-d5d452675224 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:53.330017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45dd4-7f42-48bd-a0e2-d5d452675224 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:53.330017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45dd4-7f42-48bd-a0e2-d5d452675224 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:53.332738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 271/542] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:53.339007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ab5c-19da-481c-8d06-4f1081e9efd1 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:53.339007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ab5c-19da-481c-8d06-4f1081e9efd1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:53.340087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ab5c-19da-481c-8d06-4f1081e9efd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:53.346855 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:53.360451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fb37ab5c-19da-481c-8d06-4f1081e9efd1 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:53.361671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fb37ab5c-19da-481c-8d06-4f1081e9efd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:53.455557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 272/543] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:53.493549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45dd4-7f42-48bd-a0e2-d5d452675224 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:53.634680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45dd4-7f42-48bd-a0e2-d5d452675224 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:53.679356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:53.691988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c6e7d-010a-4323-96e2-8e8794cf6fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:53.692796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6e7d-010a-4323-96e2-8e8794cf6fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:53.693071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6e7d-010a-4323-96e2-8e8794cf6fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:53.693337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6e7d-010a-4323-96e2-8e8794cf6fd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:53.706891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c6e7d-010a-4323-96e2-8e8794cf6fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-5f1c6e7d-010a-4323-96e2-8e8794cf6fd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:53.714508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:53.715382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:53.716582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 272/544] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:53.722981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ab5c-19da-481c-8d06-4f1081e9efd1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:53.892284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ab5c-19da-481c-8d06-4f1081e9efd1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:53.940471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dda129-dd9d-4a82-8ce3-c9a5ccb8ef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:53.941155 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dda129-dd9d-4a82-8ce3-c9a5ccb8ef0d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:53.941439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dda129-dd9d-4a82-8ce3-c9a5ccb8ef0d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:53.941716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dda129-dd9d-4a82-8ce3-c9a5ccb8ef0d None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:53.942494 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dda129-dd9d-4a82-8ce3-c9a5ccb8ef0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:53.942805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dda129-dd9d-4a82-8ce3-c9a5ccb8ef0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:53.944182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dda129-dd9d-4a82-8ce3-c9a5ccb8ef0d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:53.945643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:53.958700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 273/545] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:41:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:53.967641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c6e7d-010a-4323-96e2-8e8794cf6fd7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:54.007402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd035b97-4018-4b0b-85fb-963d8a8cd568 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:54.007732 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd035b97-4018-4b0b-85fb-963d8a8cd568 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:54.007958 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd035b97-4018-4b0b-85fb-963d8a8cd568 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:54.009556 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 274/546] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:54.015134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262d7f7-1a36-440a-98fa-d9d5429b379f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:54.015426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262d7f7-1a36-440a-98fa-d9d5429b379f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:54.015705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262d7f7-1a36-440a-98fa-d9d5429b379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:54.034758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9262d7f7-1a36-440a-98fa-d9d5429b379f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:54.035952 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9262d7f7-1a36-440a-98fa-d9d5429b379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:54.110574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 275/547] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:54.134566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262d7f7-1a36-440a-98fa-d9d5429b379f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:54.236293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c6e7d-010a-4323-96e2-8e8794cf6fd7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:54.245317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262d7f7-1a36-440a-98fa-d9d5429b379f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:54.282258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:54.285087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec23c49-0a99-476d-b749-eaa3fd629ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:54.289914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec23c49-0a99-476d-b749-eaa3fd629ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:54.289914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec23c49-0a99-476d-b749-eaa3fd629ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:54.289914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec23c49-0a99-476d-b749-eaa3fd629ca3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:54.314431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec23c49-0a99-476d-b749-eaa3fd629ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:54.324315 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf3be9-33a3-4e92-b629-6da42aba2f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:54.325127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3be9-33a3-4e92-b629-6da42aba2f19 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:54.325413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3be9-33a3-4e92-b629-6da42aba2f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:54.325688 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3be9-33a3-4e92-b629-6da42aba2f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-eec23c49-0a99-476d-b749-eaa3fd629ca3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:54.336408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:54.337309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:54.338596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:54.341989 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 276/548] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:54.347151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf3be9-33a3-4e92-b629-6da42aba2f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:54.348644 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf3be9-33a3-4e92-b629-6da42aba2f19 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:54.359920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec23c49-0a99-476d-b749-eaa3fd629ca3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-2bdf3be9-33a3-4e92-b629-6da42aba2f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:54.381066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:54.383838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:54.386256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:54.386256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:54.386256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:54.386256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:54.394157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 273/549] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:54.398788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf3be9-33a3-4e92-b629-6da42aba2f19 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:54.478230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:54.573561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf3be9-33a3-4e92-b629-6da42aba2f19 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:54.579468 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec23c49-0a99-476d-b749-eaa3fd629ca3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:54.612593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753f286-aea6-4de7-b982-403a6fc230af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:54.613275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753f286-aea6-4de7-b982-403a6fc230af None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:54.613560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753f286-aea6-4de7-b982-403a6fc230af None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:54.613840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753f286-aea6-4de7-b982-403a6fc230af None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:54.614759 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753f286-aea6-4de7-b982-403a6fc230af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:54.615069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753f286-aea6-4de7-b982-403a6fc230af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:54.616643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753f286-aea6-4de7-b982-403a6fc230af None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:54.631065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 274/550] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:54.642867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753f286-aea6-4de7-b982-403a6fc230af None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:54.647275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e97a58-3dd4-4f84-bc25-110af95a2845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:54.647954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e97a58-3dd4-4f84-bc25-110af95a2845 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:54.648229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e97a58-3dd4-4f84-bc25-110af95a2845 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:54.648498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e97a58-3dd4-4f84-bc25-110af95a2845 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:54.649236 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e97a58-3dd4-4f84-bc25-110af95a2845 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:54.649540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e97a58-3dd4-4f84-bc25-110af95a2845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:54.650947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e97a58-3dd4-4f84-bc25-110af95a2845 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:54.664682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 277/551] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:41:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:54.665866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e97a58-3dd4-4f84-bc25-110af95a2845 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:54.720130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:54.780430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e97a58-3dd4-4f84-bc25-110af95a2845 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:54.817801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd5109-2d41-40f1-b39d-846a4128fb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:54.818624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5109-2d41-40f1-b39d-846a4128fb92 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:54.819213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5109-2d41-40f1-b39d-846a4128fb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:54.819493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5109-2d41-40f1-b39d-846a4128fb92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:54.832408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd5109-2d41-40f1-b39d-846a4128fb92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:54.833781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd5109-2d41-40f1-b39d-846a4128fb92 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d2cd5109-2d41-40f1-b39d-846a4128fb92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:54.853633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:54.854636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:54.856213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:54.856213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:54.856213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:54.856213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:54.856213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 278/552] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:54.861989 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd5109-2d41-40f1-b39d-846a4128fb92 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:54.917873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:54.925068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753f286-aea6-4de7-b982-403a6fc230af None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:54.961963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a8f68-ccf4-47dc-9e9a-63f8bbdb3f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:54.962764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a8f68-ccf4-47dc-9e9a-63f8bbdb3f28 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:54.963039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a8f68-ccf4-47dc-9e9a-63f8bbdb3f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:54.963308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a8f68-ccf4-47dc-9e9a-63f8bbdb3f28 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:54.972164 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a8f68-ccf4-47dc-9e9a-63f8bbdb3f28 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:54.973617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a8f68-ccf4-47dc-9e9a-63f8bbdb3f28 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-0f4a8f68-ccf4-47dc-9e9a-63f8bbdb3f28 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:41:54.989255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:54.990481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:54.991705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:54.991705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:54.991705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:41:54.991705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:41:54.991705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:41:54.991705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:41:54.991705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:41:54.991705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:41:54.991705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:41:54.991705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:54.991705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 275/553] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:41:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:55.002303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a8f68-ccf4-47dc-9e9a-63f8bbdb3f28 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:55.087827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd5109-2d41-40f1-b39d-846a4128fb92 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:55.094621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:55.136243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b465dc-444e-4bb3-9cbb-41b5685f8956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:55.136905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b465dc-444e-4bb3-9cbb-41b5685f8956 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.137184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b465dc-444e-4bb3-9cbb-41b5685f8956 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.137709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b465dc-444e-4bb3-9cbb-41b5685f8956 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.138457 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b465dc-444e-4bb3-9cbb-41b5685f8956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:55.138759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b465dc-444e-4bb3-9cbb-41b5685f8956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:55.140908 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b465dc-444e-4bb3-9cbb-41b5685f8956 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:55.153002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 279/554] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:55.154087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be4210-1943-47e3-9bcc-da55115af627 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.154376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be4210-1943-47e3-9bcc-da55115af627 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.154713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be4210-1943-47e3-9bcc-da55115af627 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.156264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 280/555] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:55.160950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be4210-1943-47e3-9bcc-da55115af627 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:55.184299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a8f68-ccf4-47dc-9e9a-63f8bbdb3f28 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:55.230950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174dd9c-65f4-44a1-a808-b5955a7f9371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:55.231729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174dd9c-65f4-44a1-a808-b5955a7f9371 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.232017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174dd9c-65f4-44a1-a808-b5955a7f9371 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.232287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174dd9c-65f4-44a1-a808-b5955a7f9371 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.234053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174dd9c-65f4-44a1-a808-b5955a7f9371 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:55.234363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174dd9c-65f4-44a1-a808-b5955a7f9371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:55.236674 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174dd9c-65f4-44a1-a808-b5955a7f9371 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:55.266053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 276/556] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Jun 16 14:41:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:55.268067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17a024-36f1-4173-a89f-302612716bee None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.268826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17a024-36f1-4173-a89f-302612716bee None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.269093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17a024-36f1-4173-a89f-302612716bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.285428 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be4210-1943-47e3-9bcc-da55115af627 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:55.290847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-0e17a024-36f1-4173-a89f-302612716bee None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:55.292262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0e17a024-36f1-4173-a89f-302612716bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:55.305996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:55.333337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a640adc-b24d-49f2-8528-9fcc32f8437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:55.335148 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a640adc-b24d-49f2-8528-9fcc32f8437b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.335917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a640adc-b24d-49f2-8528-9fcc32f8437b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.336432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a640adc-b24d-49f2-8528-9fcc32f8437b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.347242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a640adc-b24d-49f2-8528-9fcc32f8437b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:55.350311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a640adc-b24d-49f2-8528-9fcc32f8437b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-1a640adc-b24d-49f2-8528-9fcc32f8437b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:41:55.370286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:55.371777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 281/557] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:55.372699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a640adc-b24d-49f2-8528-9fcc32f8437b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:55.398101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 277/558] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:55.398101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17a024-36f1-4173-a89f-302612716bee None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:55.418031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:55.526121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a640adc-b24d-49f2-8528-9fcc32f8437b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:55.526901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17a024-36f1-4173-a89f-302612716bee None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:55.563604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f275a-b711-4659-b057-f32f195d77dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:55.564270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f275a-b711-4659-b057-f32f195d77dc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.564553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f275a-b711-4659-b057-f32f195d77dc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.564830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f275a-b711-4659-b057-f32f195d77dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.565814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2005-6922-44cc-bf3f-1fa6c2be0ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:55.567482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2005-6922-44cc-bf3f-1fa6c2be0ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.568182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2005-6922-44cc-bf3f-1fa6c2be0ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.568475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2005-6922-44cc-bf3f-1fa6c2be0ab7 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.569315 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2005-6922-44cc-bf3f-1fa6c2be0ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:55.569621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2005-6922-44cc-bf3f-1fa6c2be0ab7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:55.571103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2005-6922-44cc-bf3f-1fa6c2be0ab7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:55.594219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 278/559] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Jun 16 14:41:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:55.594219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2005-6922-44cc-bf3f-1fa6c2be0ab7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:55.594219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:55.633589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f275a-b711-4659-b057-f32f195d77dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:55.635084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f275a-b711-4659-b057-f32f195d77dc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:55.656694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:55.696312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2005-6922-44cc-bf3f-1fa6c2be0ab7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:55.729796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77063b2-51e1-46d7-93c3-3692bb106f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:55.730611 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77063b2-51e1-46d7-93c3-3692bb106f45 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.730892 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77063b2-51e1-46d7-93c3-3692bb106f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.731163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77063b2-51e1-46d7-93c3-3692bb106f45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.737255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 282/560] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:55.738710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f714c-d44c-491a-9e2f-86a2643fc746 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.739103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f714c-d44c-491a-9e2f-86a2643fc746 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.739302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f714c-d44c-491a-9e2f-86a2643fc746 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.740656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 283/561] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:55.741781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a4581-05fd-44f2-89fc-94374a6e3771 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.742123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a4581-05fd-44f2-89fc-94374a6e3771 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.742400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a4581-05fd-44f2-89fc-94374a6e3771 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.743605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 284/562] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:55.744455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a4581-05fd-44f2-89fc-94374a6e3771 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:55.747177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77063b2-51e1-46d7-93c3-3692bb106f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-d77063b2-51e1-46d7-93c3-3692bb106f45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:55.755128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:55.756291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 279/563] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:55.757406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77063b2-51e1-46d7-93c3-3692bb106f45 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:55.818736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:55.851512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a4581-05fd-44f2-89fc-94374a6e3771 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:55.863002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77063b2-51e1-46d7-93c3-3692bb106f45 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:55.871688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:55.887173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fb50e-9971-4182-9bb6-2551a65d28cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:55.888158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb50e-9971-4182-9bb6-2551a65d28cb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.888440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb50e-9971-4182-9bb6-2551a65d28cb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.889355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb50e-9971-4182-9bb6-2551a65d28cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.897055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b401005-f299-46ab-8cd2-d9c57fe5f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:55.898493 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b401005-f299-46ab-8cd2-d9c57fe5f05d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.898493 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b401005-f299-46ab-8cd2-d9c57fe5f05d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.898493 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b401005-f299-46ab-8cd2-d9c57fe5f05d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.900998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fb50e-9971-4182-9bb6-2551a65d28cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:55.902479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fb50e-9971-4182-9bb6-2551a65d28cb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:55.910008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b401005-f299-46ab-8cd2-d9c57fe5f05d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:55.911426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b401005-f299-46ab-8cd2-d9c57fe5f05d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-c36fb50e-9971-4182-9bb6-2551a65d28cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:55.921444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:55.922361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:55.923252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:55.923252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:55.923252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:55.923252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:55.923252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 285/564] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:55.923846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20f90f-fbb1-4152-ab60-2aaaf3a3f67a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.924125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20f90f-fbb1-4152-ab60-2aaaf3a3f67a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.924399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20f90f-fbb1-4152-ab60-2aaaf3a3f67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-5b401005-f299-46ab-8cd2-d9c57fe5f05d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:55.929135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:55.931033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:55.931901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:55.931901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:55.931901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:55.931901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:55.931901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 280/565] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:55.931901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0401d7c-1479-49d7-ab69-333cd31960a2 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:55.931901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0401d7c-1479-49d7-ab69-333cd31960a2 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:55.932728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0401d7c-1479-49d7-ab69-333cd31960a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:55.940704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fe20f90f-fbb1-4152-ab60-2aaaf3a3f67a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:55.941943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fe20f90f-fbb1-4152-ab60-2aaaf3a3f67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:55.948035 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a0401d7c-1479-49d7-ab69-333cd31960a2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:55.949197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a0401d7c-1479-49d7-ab69-333cd31960a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:56.007616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 286/566] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:56.008444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20f90f-fbb1-4152-ab60-2aaaf3a3f67a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.017701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 281/567] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:56.018756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0401d7c-1479-49d7-ab69-333cd31960a2 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.074342 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:56.120243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20f90f-fbb1-4152-ab60-2aaaf3a3f67a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.121742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:56.130044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0401d7c-1479-49d7-ab69-333cd31960a2 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.157169 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e5061-81a6-4317-9365-7e1cc673e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.157765 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e5061-81a6-4317-9365-7e1cc673e752 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.158063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e5061-81a6-4317-9365-7e1cc673e752 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.158336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e5061-81a6-4317-9365-7e1cc673e752 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.159071 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e5061-81a6-4317-9365-7e1cc673e752 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:56.159370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e5061-81a6-4317-9365-7e1cc673e752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.160728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e5061-81a6-4317-9365-7e1cc673e752 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.166805 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bac15-02b0-4568-a6f7-3884e75104b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.167477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bac15-02b0-4568-a6f7-3884e75104b9 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.167764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bac15-02b0-4568-a6f7-3884e75104b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.168041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bac15-02b0-4568-a6f7-3884e75104b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.168602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 287/568] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:56.168761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bac15-02b0-4568-a6f7-3884e75104b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:56.169064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bac15-02b0-4568-a6f7-3884e75104b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.169366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e5061-81a6-4317-9365-7e1cc673e752 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.170621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bac15-02b0-4568-a6f7-3884e75104b9 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.187667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 282/569] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:56.187667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bac15-02b0-4568-a6f7-3884e75104b9 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.279332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e5061-81a6-4317-9365-7e1cc673e752 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.286854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bac15-02b0-4568-a6f7-3884e75104b9 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.289238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:56.317677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8346922-044b-48b0-8c73-2617c6b806a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.318371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8346922-044b-48b0-8c73-2617c6b806a7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.318653 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8346922-044b-48b0-8c73-2617c6b806a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.318929 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8346922-044b-48b0-8c73-2617c6b806a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.319643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8346922-044b-48b0-8c73-2617c6b806a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:56.319950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8346922-044b-48b0-8c73-2617c6b806a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.321233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297bfbd-9593-47aa-960b-e393b69f0b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.321345 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8346922-044b-48b0-8c73-2617c6b806a7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.322064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297bfbd-9593-47aa-960b-e393b69f0b9e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.322351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297bfbd-9593-47aa-960b-e393b69f0b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.322799 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297bfbd-9593-47aa-960b-e393b69f0b9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.333000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297bfbd-9593-47aa-960b-e393b69f0b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:56.333534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 288/570] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:56.334358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8346922-044b-48b0-8c73-2617c6b806a7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-b297bfbd-9593-47aa-960b-e393b69f0b9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:56.340874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:56.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 283/571] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:56.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297bfbd-9593-47aa-960b-e393b69f0b9e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.362794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:56.441852 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8346922-044b-48b0-8c73-2617c6b806a7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.453778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297bfbd-9593-47aa-960b-e393b69f0b9e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.475924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e676152-b33a-4eb1-83b1-40b0009a4c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.476721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e676152-b33a-4eb1-83b1-40b0009a4c4b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.477006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e676152-b33a-4eb1-83b1-40b0009a4c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.477279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e676152-b33a-4eb1-83b1-40b0009a4c4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.488268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e676152-b33a-4eb1-83b1-40b0009a4c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:56.488490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d869a-e90f-4fad-a659-ccc54fa49650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.489300 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d869a-e90f-4fad-a659-ccc54fa49650 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.489576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d869a-e90f-4fad-a659-ccc54fa49650 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.489846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d869a-e90f-4fad-a659-ccc54fa49650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4e676152-b33a-4eb1-83b1-40b0009a4c4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:56.496017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:56.496942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:41:56.497754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:56.502034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d869a-e90f-4fad-a659-ccc54fa49650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.502272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 289/572] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:56.503250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e676152-b33a-4eb1-83b1-40b0009a4c4b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.503495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d869a-e90f-4fad-a659-ccc54fa49650 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-dc7d869a-e90f-4fad-a659-ccc54fa49650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:56.521535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:56.522660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:56.523743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:56.523743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:56.523743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:56.523743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:56.523743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 284/573] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:56.523743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d869a-e90f-4fad-a659-ccc54fa49650 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.542266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:56.593541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:56.610475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e676152-b33a-4eb1-83b1-40b0009a4c4b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.630563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d869a-e90f-4fad-a659-ccc54fa49650 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.645737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6440dbc-8185-459c-b742-3a6e8b3ab8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.646572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6440dbc-8185-459c-b742-3a6e8b3ab8fd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.646854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6440dbc-8185-459c-b742-3a6e8b3ab8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.647129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6440dbc-8185-459c-b742-3a6e8b3ab8fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.653653 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6440dbc-8185-459c-b742-3a6e8b3ab8fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.655495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6440dbc-8185-459c-b742-3a6e8b3ab8fd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.665302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096842ad-c40a-4ec4-b71e-088a9af2b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.666131 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096842ad-c40a-4ec4-b71e-088a9af2b697 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.666416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096842ad-c40a-4ec4-b71e-088a9af2b697 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.666690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096842ad-c40a-4ec4-b71e-088a9af2b697 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f6440dbc-8185-459c-b742-3a6e8b3ab8fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:41:56.669856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:56.671378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:56.672360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:41:56.672360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:41:56.672360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:41:56.672360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:41:56.672360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:41:56.672360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:41:56.672360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:56.672360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:56.674541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096842ad-c40a-4ec4-b71e-088a9af2b697 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.675996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096842ad-c40a-4ec4-b71e-088a9af2b697 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.676741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 290/574] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:56.677366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6440dbc-8185-459c-b742-3a6e8b3ab8fd None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-096842ad-c40a-4ec4-b71e-088a9af2b697 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:41:56.690928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:56.691982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:56.693118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:41:56.693118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:41:56.693118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:41:56.693118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:41:56.693118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:41:56.693118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:41:56.693118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:56.693118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:56.693118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 285/575] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:56.693118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096842ad-c40a-4ec4-b71e-088a9af2b697 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.770557 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:56.782280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6440dbc-8185-459c-b742-3a6e8b3ab8fd None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.796058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096842ad-c40a-4ec4-b71e-088a9af2b697 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.817845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dc230-34f3-4308-8d65-6a12c9dee1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.818539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc230-34f3-4308-8d65-6a12c9dee1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.818821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc230-34f3-4308-8d65-6a12c9dee1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.819094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc230-34f3-4308-8d65-6a12c9dee1f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.819833 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dc230-34f3-4308-8d65-6a12c9dee1f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:56.820140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dc230-34f3-4308-8d65-6a12c9dee1f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.821492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dc230-34f3-4308-8d65-6a12c9dee1f9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.829423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 291/576] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:56.830243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dc230-34f3-4308-8d65-6a12c9dee1f9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.831324 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c3d0e-2436-4bed-addd-8e78d207e3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.832007 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3d0e-2436-4bed-addd-8e78d207e3ff None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.832291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3d0e-2436-4bed-addd-8e78d207e3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.832575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3d0e-2436-4bed-addd-8e78d207e3ff None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.833326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c3d0e-2436-4bed-addd-8e78d207e3ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:56.833634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c3d0e-2436-4bed-addd-8e78d207e3ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.835450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c3d0e-2436-4bed-addd-8e78d207e3ff None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.839715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:56.845141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 286/577] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:56.846159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c3d0e-2436-4bed-addd-8e78d207e3ff None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.938545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dc230-34f3-4308-8d65-6a12c9dee1f9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.949386 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c3d0e-2436-4bed-addd-8e78d207e3ff None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.971910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b73214-bb61-487a-8d77-8bc8245f11cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.972570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73214-bb61-487a-8d77-8bc8245f11cc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.972845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73214-bb61-487a-8d77-8bc8245f11cc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.973117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73214-bb61-487a-8d77-8bc8245f11cc None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.973822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b73214-bb61-487a-8d77-8bc8245f11cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:56.974155 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b73214-bb61-487a-8d77-8bc8245f11cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.975510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b73214-bb61-487a-8d77-8bc8245f11cc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.983491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee79cc-e263-48f8-b720-2ce4e571351b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.984152 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee79cc-e263-48f8-b720-2ce4e571351b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.984437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee79cc-e263-48f8-b720-2ce4e571351b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.984714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee79cc-e263-48f8-b720-2ce4e571351b None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.985501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee79cc-e263-48f8-b720-2ce4e571351b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:56.985809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee79cc-e263-48f8-b720-2ce4e571351b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.987105 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 292/578] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:56.987268 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee79cc-e263-48f8-b720-2ce4e571351b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.987887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b73214-bb61-487a-8d77-8bc8245f11cc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.998800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:57.004845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 287/579] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:57.005988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee79cc-e263-48f8-b720-2ce4e571351b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:57.055906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:57.090820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b73214-bb61-487a-8d77-8bc8245f11cc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:57.105677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee79cc-e263-48f8-b720-2ce4e571351b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:57.124596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5ce5b-16f8-4b1f-b039-c10d9feaf0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:57.125245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ce5b-16f8-4b1f-b039-c10d9feaf0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:57.125525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ce5b-16f8-4b1f-b039-c10d9feaf0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:57.125795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ce5b-16f8-4b1f-b039-c10d9feaf0e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:57.126619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5ce5b-16f8-4b1f-b039-c10d9feaf0e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:57.126929 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5ce5b-16f8-4b1f-b039-c10d9feaf0e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:57.128343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5ce5b-16f8-4b1f-b039-c10d9feaf0e7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:57.140849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 293/580] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:57.141000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f30787-1de6-4ddd-a5aa-68a8ef0f490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:57.141996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5ce5b-16f8-4b1f-b039-c10d9feaf0e7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:57.142191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f30787-1de6-4ddd-a5aa-68a8ef0f490e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:57.142191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f30787-1de6-4ddd-a5aa-68a8ef0f490e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:57.142525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f30787-1de6-4ddd-a5aa-68a8ef0f490e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:57.155929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f30787-1de6-4ddd-a5aa-68a8ef0f490e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:57.157367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f30787-1de6-4ddd-a5aa-68a8ef0f490e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-b5f30787-1de6-4ddd-a5aa-68a8ef0f490e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:57.175266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:57.176377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:57.177553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:57.177553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:57.177553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:57.177553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:57.177553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 288/581] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:57.177553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f30787-1de6-4ddd-a5aa-68a8ef0f490e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:57.227715 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:57.248173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5ce5b-16f8-4b1f-b039-c10d9feaf0e7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:57.273540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:57.279138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f30787-1de6-4ddd-a5aa-68a8ef0f490e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:57.283080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc85394-de9f-42aa-9982-3b4fb78e3366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:57.283874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc85394-de9f-42aa-9982-3b4fb78e3366 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:57.284152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc85394-de9f-42aa-9982-3b4fb78e3366 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:57.284420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc85394-de9f-42aa-9982-3b4fb78e3366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:57.295656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc85394-de9f-42aa-9982-3b4fb78e3366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:57.297128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc85394-de9f-42aa-9982-3b4fb78e3366 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-1fc85394-de9f-42aa-9982-3b4fb78e3366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:57.314358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:57.315417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:57.316289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:57.316289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:57.316289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:57.316289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:57.316516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906477d-e994-4a60-b921-4ff5c88219c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:57.316516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906477d-e994-4a60-b921-4ff5c88219c3 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:57.316672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 294/582] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:57.316746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906477d-e994-4a60-b921-4ff5c88219c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:57.316746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906477d-e994-4a60-b921-4ff5c88219c3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:57.316887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc85394-de9f-42aa-9982-3b4fb78e3366 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:57.326407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906477d-e994-4a60-b921-4ff5c88219c3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:57.327910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906477d-e994-4a60-b921-4ff5c88219c3 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-e906477d-e994-4a60-b921-4ff5c88219c3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:41:57.342878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:57.344041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 289/583] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:57.345225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906477d-e994-4a60-b921-4ff5c88219c3 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:57.423557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc85394-de9f-42aa-9982-3b4fb78e3366 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:57.446584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906477d-e994-4a60-b921-4ff5c88219c3 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:57.457176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:57.458465 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3d092-07e0-4768-a450-8ce11f5e4dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:57.459562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3d092-07e0-4768-a450-8ce11f5e4dc6 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:57.459969 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3d092-07e0-4768-a450-8ce11f5e4dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:57.460256 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3d092-07e0-4768-a450-8ce11f5e4dc6 None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/cb9c1cc51e544c90a629feb312a80c71/roles/6e6c598a68fa410f949be49b804af3f5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:57.475669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3d092-07e0-4768-a450-8ce11f5e4dc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=cb9c1cc51e544c90a629feb312a80c71, role_id=6e6c598a68fa410f949be49b804af3f5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:57.477118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3d092-07e0-4768-a450-8ce11f5e4dc6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:57.483103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24170389-638a-40b0-9c0d-8b49017f67c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:57.483948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24170389-638a-40b0-9c0d-8b49017f67c5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:57.484358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24170389-638a-40b0-9c0d-8b49017f67c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:57.484783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24170389-638a-40b0-9c0d-8b49017f67c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:57.485826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24170389-638a-40b0-9c0d-8b49017f67c5 None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=c0e6fc45641f4c279def2d4aa971978d) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:57.486167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24170389-638a-40b0-9c0d-8b49017f67c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:57.487599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24170389-638a-40b0-9c0d-8b49017f67c5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:57.491079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 295/584] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:41:57 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/cb9c1cc51e544c90a629feb312a80c71/roles/6e6c598a68fa410f949be49b804af3f5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:57.491906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3d092-07e0-4768-a450-8ce11f5e4dc6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:57.498150 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 290/585] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:41:57 2022] GET /identity/v3/role_assignments?user.id=c0e6fc45641f4c279def2d4aa971978d&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:57.500302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24170389-638a-40b0-9c0d-8b49017f67c5 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:57.529769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:57.639650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3d092-07e0-4768-a450-8ce11f5e4dc6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:57.669280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24170389-638a-40b0-9c0d-8b49017f67c5 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:57.698939 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de4e17-7e48-453f-a1df-49ce65c7367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:57.699609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4e17-7e48-453f-a1df-49ce65c7367a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:57.699885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4e17-7e48-453f-a1df-49ce65c7367a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:57.700162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4e17-7e48-453f-a1df-49ce65c7367a None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:57.701588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de4e17-7e48-453f-a1df-49ce65c7367a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:57.702013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de4e17-7e48-453f-a1df-49ce65c7367a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:57.703824 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de4e17-7e48-453f-a1df-49ce65c7367a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:57.716444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 296/586] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:57.717821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de4e17-7e48-453f-a1df-49ce65c7367a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:57.721854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991431a-532e-42d4-b90f-fe9c83dcf6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:57.722801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991431a-532e-42d4-b90f-fe9c83dcf6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:57.723114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991431a-532e-42d4-b90f-fe9c83dcf6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:57.723470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991431a-532e-42d4-b90f-fe9c83dcf6e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:57.724273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991431a-532e-42d4-b90f-fe9c83dcf6e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:57.724652 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991431a-532e-42d4-b90f-fe9c83dcf6e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:57.726207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991431a-532e-42d4-b90f-fe9c83dcf6e1 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:57.741692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 291/587] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:57.742955 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991431a-532e-42d4-b90f-fe9c83dcf6e1 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:57.783243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:57.844347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:57.871280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de4e17-7e48-453f-a1df-49ce65c7367a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:57.871921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991431a-532e-42d4-b90f-fe9c83dcf6e1 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:57.910374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9506a5-1c50-44bb-8977-b2e2361bf7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:57.911062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9506a5-1c50-44bb-8977-b2e2361bf7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:57.911348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9506a5-1c50-44bb-8977-b2e2361bf7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:57.911623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9506a5-1c50-44bb-8977-b2e2361bf7c1 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:57.912462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9506a5-1c50-44bb-8977-b2e2361bf7c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:57.912776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9506a5-1c50-44bb-8977-b2e2361bf7c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:57.914344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9506a5-1c50-44bb-8977-b2e2361bf7c1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:57.914948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18fc6f-9db7-4ef1-a4a8-a206af802f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:57.916035 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18fc6f-9db7-4ef1-a4a8-a206af802f3e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:57.916468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18fc6f-9db7-4ef1-a4a8-a206af802f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:57.916912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18fc6f-9db7-4ef1-a4a8-a206af802f3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:57.926163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18fc6f-9db7-4ef1-a4a8-a206af802f3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:57.927848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18fc6f-9db7-4ef1-a4a8-a206af802f3e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:57.945040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 297/588] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Jun 16 14:41:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:57.946227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9506a5-1c50-44bb-8977-b2e2361bf7c1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-ff18fc6f-9db7-4ef1-a4a8-a206af802f3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:41:57.948889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:57.950051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:57.951021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:57.951021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:57.951021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:41:57.951021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:41:57.951021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:41:57.951021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:41:57.951021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:41:57.951021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:41:57.951021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:41:57.951021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:57.956456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 292/589] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Jun 16 14:41:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:57.957435 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18fc6f-9db7-4ef1-a4a8-a206af802f3e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:58.056945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9506a5-1c50-44bb-8977-b2e2361bf7c1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:58.065315 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:58.075260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18fc6f-9db7-4ef1-a4a8-a206af802f3e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:58.092104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbbcc4-c07f-4eaa-a377-af7a98b77525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:58.092998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbbcc4-c07f-4eaa-a377-af7a98b77525 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.093280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbbcc4-c07f-4eaa-a377-af7a98b77525 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.093553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbbcc4-c07f-4eaa-a377-af7a98b77525 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.101486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbbcc4-c07f-4eaa-a377-af7a98b77525 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:58.102948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbbcc4-c07f-4eaa-a377-af7a98b77525 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d9cbbcc4-c07f-4eaa-a377-af7a98b77525 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:41:58.119686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:58.120698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:58.121634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:58.121634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:58.121634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:41:58.121634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:41:58.121634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:41:58.121634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:41:58.121634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:41:58.121634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:41:58.121634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:41:58.121634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:58.122848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040f555-a65a-429e-a3a4-4d2e87637bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:58.123879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040f555-a65a-429e-a3a4-4d2e87637bad None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.124421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040f555-a65a-429e-a3a4-4d2e87637bad None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.124862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040f555-a65a-429e-a3a4-4d2e87637bad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.125759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 298/590] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:58.126737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbbcc4-c07f-4eaa-a377-af7a98b77525 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:58.135409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:58.141514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040f555-a65a-429e-a3a4-4d2e87637bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:58.143950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040f555-a65a-429e-a3a4-4d2e87637bad None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-f040f555-a65a-429e-a3a4-4d2e87637bad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:58.169373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:58.171122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:58.172139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:58.172139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:58.172139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:58.172139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:58.174051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 293/591] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:58.175021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040f555-a65a-429e-a3a4-4d2e87637bad None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:58.246961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbbcc4-c07f-4eaa-a377-af7a98b77525 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:58.291246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaebac-32ae-494a-842a-499d71cd9170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:58.292231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaebac-32ae-494a-842a-499d71cd9170 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.292618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaebac-32ae-494a-842a-499d71cd9170 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.293220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaebac-32ae-494a-842a-499d71cd9170 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.294366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaebac-32ae-494a-842a-499d71cd9170 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:58.294679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaebac-32ae-494a-842a-499d71cd9170 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:58.298189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaebac-32ae-494a-842a-499d71cd9170 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:58.303671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040f555-a65a-429e-a3a4-4d2e87637bad None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:58.320589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 299/592] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Jun 16 14:41:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:58.321357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaebac-32ae-494a-842a-499d71cd9170 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:58.359729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc694f1-30dd-47df-8c09-18ff916a774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:58.360675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc694f1-30dd-47df-8c09-18ff916a774b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.361419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc694f1-30dd-47df-8c09-18ff916a774b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.361698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc694f1-30dd-47df-8c09-18ff916a774b None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.362855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc694f1-30dd-47df-8c09-18ff916a774b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:58.363166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc694f1-30dd-47df-8c09-18ff916a774b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:58.364886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc694f1-30dd-47df-8c09-18ff916a774b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:58.395479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 294/593] 10.222.0.81 () {56 vars in 1139 bytes} [Thu Jun 16 14:41:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:58.396349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc694f1-30dd-47df-8c09-18ff916a774b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:58.400341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:58.403811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:58.446824 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaebac-32ae-494a-842a-499d71cd9170 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:58.488813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80f78c-4624-4164-a755-4e07b4358bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:58.489488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80f78c-4624-4164-a755-4e07b4358bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.489771 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80f78c-4624-4164-a755-4e07b4358bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.490089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80f78c-4624-4164-a755-4e07b4358bb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.490805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80f78c-4624-4164-a755-4e07b4358bb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:58.491111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80f78c-4624-4164-a755-4e07b4358bb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:58.492741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80f78c-4624-4164-a755-4e07b4358bb8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:58.509187 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 300/594] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:58.517909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80f78c-4624-4164-a755-4e07b4358bb8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:58.538652 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc694f1-30dd-47df-8c09-18ff916a774b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:58.582738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c151b-2b09-47ae-aa6b-e12831d6047c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:58.583904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c151b-2b09-47ae-aa6b-e12831d6047c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.584446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c151b-2b09-47ae-aa6b-e12831d6047c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.584925 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c151b-2b09-47ae-aa6b-e12831d6047c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.597909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c151b-2b09-47ae-aa6b-e12831d6047c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:58.599707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c151b-2b09-47ae-aa6b-e12831d6047c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-f86c151b-2b09-47ae-aa6b-e12831d6047c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:58.620681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:58.621662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:58.622582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:58.622582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:58.622582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:58.622582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:58.625645 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 295/595] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:58.627582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c151b-2b09-47ae-aa6b-e12831d6047c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:58.649614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80f78c-4624-4164-a755-4e07b4358bb8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:58.682191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:58.694888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2724ce6-dee1-4f44-ae34-777b394ed1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:58.695721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2724ce6-dee1-4f44-ae34-777b394ed1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.696340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2724ce6-dee1-4f44-ae34-777b394ed1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.696340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2724ce6-dee1-4f44-ae34-777b394ed1f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.700506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:58.710457 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2724ce6-dee1-4f44-ae34-777b394ed1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:58.712143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2724ce6-dee1-4f44-ae34-777b394ed1f9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-e2724ce6-dee1-4f44-ae34-777b394ed1f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:58.732672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:58.734363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:58.735215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:58.735215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:58.735215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:58.735215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:58.737656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 301/596] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:58.738762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2724ce6-dee1-4f44-ae34-777b394ed1f9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:58.759806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c151b-2b09-47ae-aa6b-e12831d6047c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:58.802422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f2e9e-1a5b-480d-ad45-02982a58d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:58.803466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f2e9e-1a5b-480d-ad45-02982a58d894 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.803875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f2e9e-1a5b-480d-ad45-02982a58d894 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.804236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f2e9e-1a5b-480d-ad45-02982a58d894 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.811905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f2e9e-1a5b-480d-ad45-02982a58d894 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:58.813692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f2e9e-1a5b-480d-ad45-02982a58d894 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-793f2e9e-1a5b-480d-ad45-02982a58d894 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:41:58.829453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:58.830422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:58.831373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:41:58.831373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:41:58.831373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:41:58.831373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:41:58.831373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:41:58.831373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:41:58.831373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:58.831373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:58.831373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 296/597] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:58.831373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f2e9e-1a5b-480d-ad45-02982a58d894 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:58.869573 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2724ce6-dee1-4f44-ae34-777b394ed1f9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:58.909355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4033f5f-2838-480c-9b98-d9b9bfab037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:58.910456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4033f5f-2838-480c-9b98-d9b9bfab037a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.910932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4033f5f-2838-480c-9b98-d9b9bfab037a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.911413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4033f5f-2838-480c-9b98-d9b9bfab037a None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.912304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4033f5f-2838-480c-9b98-d9b9bfab037a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:58.912794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4033f5f-2838-480c-9b98-d9b9bfab037a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:58.914376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4033f5f-2838-480c-9b98-d9b9bfab037a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:58.932225 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 302/598] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:58.933307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4033f5f-2838-480c-9b98-d9b9bfab037a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:58.943134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f2e9e-1a5b-480d-ad45-02982a58d894 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:58.966210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:58.970115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:58.987032 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c4675-9f4b-4f92-8ed4-6bec06ba777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:58.988307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c4675-9f4b-4f92-8ed4-6bec06ba777c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.988790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c4675-9f4b-4f92-8ed4-6bec06ba777c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.989214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c4675-9f4b-4f92-8ed4-6bec06ba777c None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.990119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c4675-9f4b-4f92-8ed4-6bec06ba777c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:58.990593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c4675-9f4b-4f92-8ed4-6bec06ba777c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:58.992276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c4675-9f4b-4f92-8ed4-6bec06ba777c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.005681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 297/599] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:59.007155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c4675-9f4b-4f92-8ed4-6bec06ba777c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.040522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4033f5f-2838-480c-9b98-d9b9bfab037a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.077173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67bc0-4850-49c7-aed8-9dda9f56ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.078006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67bc0-4850-49c7-aed8-9dda9f56ee29 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.078397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67bc0-4850-49c7-aed8-9dda9f56ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.078762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67bc0-4850-49c7-aed8-9dda9f56ee29 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.079639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa67bc0-4850-49c7-aed8-9dda9f56ee29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:59.080042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa67bc0-4850-49c7-aed8-9dda9f56ee29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.081582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa67bc0-4850-49c7-aed8-9dda9f56ee29 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.094450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 303/600] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:59.095553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67bc0-4850-49c7-aed8-9dda9f56ee29 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.117914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c4675-9f4b-4f92-8ed4-6bec06ba777c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.157652 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a51b4f-40f8-4fcd-b602-64977aca5ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.158905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a51b4f-40f8-4fcd-b602-64977aca5ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.159381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a51b4f-40f8-4fcd-b602-64977aca5ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.159855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a51b4f-40f8-4fcd-b602-64977aca5ac5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.167761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a51b4f-40f8-4fcd-b602-64977aca5ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.169603 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a51b4f-40f8-4fcd-b602-64977aca5ac5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-d7a51b4f-40f8-4fcd-b602-64977aca5ac5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:41:59.186418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:59.187366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:59.188251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:41:59.188251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:41:59.188251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:41:59.188251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:41:59.188251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:41:59.188251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:41:59.188251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:59.188251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:41:59.191210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 298/601] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:59.192315 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a51b4f-40f8-4fcd-b602-64977aca5ac5 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.203541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.210360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67bc0-4850-49c7-aed8-9dda9f56ee29 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.250260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.254080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e201a1-e2f7-4482-a85d-4e703bed3150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.254979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e201a1-e2f7-4482-a85d-4e703bed3150 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.255315 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e201a1-e2f7-4482-a85d-4e703bed3150 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.255661 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e201a1-e2f7-4482-a85d-4e703bed3150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.263099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e201a1-e2f7-4482-a85d-4e703bed3150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.264945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e201a1-e2f7-4482-a85d-4e703bed3150 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-01e201a1-e2f7-4482-a85d-4e703bed3150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:41:59.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:59.281877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:59.282983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:41:59.282983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:41:59.282983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:41:59.282983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:41:59.282983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:41:59.282983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:41:59.282983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:41:59.282983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:41:59.287912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 304/602] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:59.288698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e201a1-e2f7-4482-a85d-4e703bed3150 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.336215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a51b4f-40f8-4fcd-b602-64977aca5ac5 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.381001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5c9c6-0871-4f23-84fe-3fc1c2fc369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.382298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5c9c6-0871-4f23-84fe-3fc1c2fc369e None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.384242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5c9c6-0871-4f23-84fe-3fc1c2fc369e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.384691 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5c9c6-0871-4f23-84fe-3fc1c2fc369e None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/c41347251cac48c3a2ee7fa6d2fe4cbb/roles/6e6c598a68fa410f949be49b804af3f5` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.403648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5c9c6-0871-4f23-84fe-3fc1c2fc369e None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=c41347251cac48c3a2ee7fa6d2fe4cbb, role_id=6e6c598a68fa410f949be49b804af3f5)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.405772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5c9c6-0871-4f23-84fe-3fc1c2fc369e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.413590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e201a1-e2f7-4482-a85d-4e703bed3150 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.422302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 299/603] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:41:59 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/c41347251cac48c3a2ee7fa6d2fe4cbb/roles/6e6c598a68fa410f949be49b804af3f5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:41:59.423524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5c9c6-0871-4f23-84fe-3fc1c2fc369e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.477690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef797b0-8665-48fc-bc7d-b93f4b48f833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.478475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef797b0-8665-48fc-bc7d-b93f4b48f833 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.478717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef797b0-8665-48fc-bc7d-b93f4b48f833 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.479051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef797b0-8665-48fc-bc7d-b93f4b48f833 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.479859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef797b0-8665-48fc-bc7d-b93f4b48f833 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:59.481212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef797b0-8665-48fc-bc7d-b93f4b48f833 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.483858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef797b0-8665-48fc-bc7d-b93f4b48f833 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.512248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 305/604] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:59.524458 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef797b0-8665-48fc-bc7d-b93f4b48f833 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.559993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.598273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.632492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5c9c6-0871-4f23-84fe-3fc1c2fc369e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.694263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eace8a-e2fc-47ab-9de1-58905f6310a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.695288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eace8a-e2fc-47ab-9de1-58905f6310a8 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.695775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eace8a-e2fc-47ab-9de1-58905f6310a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.696237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef797b0-8665-48fc-bc7d-b93f4b48f833 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.696477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eace8a-e2fc-47ab-9de1-58905f6310a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.697485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eace8a-e2fc-47ab-9de1-58905f6310a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:59.698180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eace8a-e2fc-47ab-9de1-58905f6310a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.699992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eace8a-e2fc-47ab-9de1-58905f6310a8 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.714221 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 300/605] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:59.719715 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f777a1-5781-45c9-86b5-d2ab8f6536f3 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.720424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f777a1-5781-45c9-86b5-d2ab8f6536f3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.720906 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f777a1-5781-45c9-86b5-d2ab8f6536f3 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.722841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 301/606] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:59.727900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275811f-928a-48f0-b591-6de6139cfc15 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.728640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275811f-928a-48f0-b591-6de6139cfc15 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.729120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275811f-928a-48f0-b591-6de6139cfc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.743724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46222d1-8f8c-4338-a87e-e66ba3c1aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.744753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46222d1-8f8c-4338-a87e-e66ba3c1aa23 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.745049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46222d1-8f8c-4338-a87e-e66ba3c1aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.745446 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46222d1-8f8c-4338-a87e-e66ba3c1aa23 None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/f2faa046b0294a0ba1090be84bb1cebc/roles/6e6c598a68fa410f949be49b804af3f5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.755379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-e275811f-928a-48f0-b591-6de6139cfc15 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:59.756893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e275811f-928a-48f0-b591-6de6139cfc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:59.761997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46222d1-8f8c-4338-a87e-e66ba3c1aa23 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=f2faa046b0294a0ba1090be84bb1cebc, role_id=6e6c598a68fa410f949be49b804af3f5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.764044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46222d1-8f8c-4338-a87e-e66ba3c1aa23 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.781750 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 306/607] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:41:59 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/f2faa046b0294a0ba1090be84bb1cebc/roles/6e6c598a68fa410f949be49b804af3f5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:41:59.782983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46222d1-8f8c-4338-a87e-e66ba3c1aa23 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.898081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 302/608] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:59.911137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.933403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275811f-928a-48f0-b591-6de6139cfc15 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.950875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46222d1-8f8c-4338-a87e-e66ba3c1aa23 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.989912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5404c0-c545-4627-9445-549d8699fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.990830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5404c0-c545-4627-9445-549d8699fff8 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.991107 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5404c0-c545-4627-9445-549d8699fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.991372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5404c0-c545-4627-9445-549d8699fff8 None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/8940bddd49534f01a8b1bf1dee644216/roles/6e6c598a68fa410f949be49b804af3f5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:00.012357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5404c0-c545-4627-9445-549d8699fff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=8940bddd49534f01a8b1bf1dee644216, role_id=6e6c598a68fa410f949be49b804af3f5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:00.014738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5404c0-c545-4627-9445-549d8699fff8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:00.034553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 307/609] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:41:59 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/8940bddd49534f01a8b1bf1dee644216/roles/6e6c598a68fa410f949be49b804af3f5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:00.036287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b2791-771b-449f-980b-3b5cb180a19b None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:00.036573 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b2791-771b-449f-980b-3b5cb180a19b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:00.036853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b2791-771b-449f-980b-3b5cb180a19b None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:00.039477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 308/610] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:00.046089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a034ef4-f4bf-4a01-ab74-8e7a40c0fe53 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:00.046410 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a034ef4-f4bf-4a01-ab74-8e7a40c0fe53 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:00.046663 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a034ef4-f4bf-4a01-ab74-8e7a40c0fe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:00.070596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3a034ef4-f4bf-4a01-ab74-8e7a40c0fe53 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:00.073354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:00.073625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3a034ef4-f4bf-4a01-ab74-8e7a40c0fe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:00.079529 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275811f-928a-48f0-b591-6de6139cfc15 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:00.118775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194688db-486f-4771-a1d6-7fbbcb8d9bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:00.119756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194688db-486f-4771-a1d6-7fbbcb8d9bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:00.120044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194688db-486f-4771-a1d6-7fbbcb8d9bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:00.120382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194688db-486f-4771-a1d6-7fbbcb8d9bf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:00.133309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194688db-486f-4771-a1d6-7fbbcb8d9bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-194688db-486f-4771-a1d6-7fbbcb8d9bf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:00.142470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:00.143502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:00.144821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 303/611] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:00.149953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194688db-486f-4771-a1d6-7fbbcb8d9bf9 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:00.162806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 309/612] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:00.187777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a034ef4-f4bf-4a01-ab74-8e7a40c0fe53 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:00.241146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:00.272457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194688db-486f-4771-a1d6-7fbbcb8d9bf9 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:00.309632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a034ef4-f4bf-4a01-ab74-8e7a40c0fe53 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:00.310939 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09bab7-44d3-4c29-b95f-3822f5f25098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:00.311945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09bab7-44d3-4c29-b95f-3822f5f25098 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:00.312234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09bab7-44d3-4c29-b95f-3822f5f25098 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:00.312513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09bab7-44d3-4c29-b95f-3822f5f25098 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:00.313276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09bab7-44d3-4c29-b95f-3822f5f25098 None admin] RBAC: Adding query filter params (name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:00.313627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09bab7-44d3-4c29-b95f-3822f5f25098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:00.315054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09bab7-44d3-4c29-b95f-3822f5f25098 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:00.317537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:00.325220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 304/613] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:00.332976 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09bab7-44d3-4c29-b95f-3822f5f25098 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:00.349986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960a40e-0487-44f0-b83e-72212412b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:00.350929 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a40e-0487-44f0-b83e-72212412b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:00.351267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a40e-0487-44f0-b83e-72212412b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:00.351550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a40e-0487-44f0-b83e-72212412b5c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:00.364069 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960a40e-0487-44f0-b83e-72212412b5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-5960a40e-0487-44f0-b83e-72212412b5c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:00.372613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:00.373871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:00.374889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 310/614] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:00.380400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960a40e-0487-44f0-b83e-72212412b5c5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:00.445056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09bab7-44d3-4c29-b95f-3822f5f25098 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:00.482226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b458a06-7e88-4e10-b02f-319f7be12e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:00.483878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458a06-7e88-4e10-b02f-319f7be12e5b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:00.484207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458a06-7e88-4e10-b02f-319f7be12e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:00.484600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458a06-7e88-4e10-b02f-319f7be12e5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:00.496129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b458a06-7e88-4e10-b02f-319f7be12e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:00.497514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b458a06-7e88-4e10-b02f-319f7be12e5b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-2b458a06-7e88-4e10-b02f-319f7be12e5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:00.525915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:00.526873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:00.527748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:00.527748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:00.527748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:00.527748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:00.527748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 305/615] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:00.530137 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b458a06-7e88-4e10-b02f-319f7be12e5b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:00.591655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:00.602981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960a40e-0487-44f0-b83e-72212412b5c5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:00.618445 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:00.642968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b458a06-7e88-4e10-b02f-319f7be12e5b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:00.691938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b696857-5740-4f6a-9b38-eed82ca016ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:00.692865 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b696857-5740-4f6a-9b38-eed82ca016ac None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:00.693296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b696857-5740-4f6a-9b38-eed82ca016ac None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:00.693720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b696857-5740-4f6a-9b38-eed82ca016ac None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:00.694786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b696857-5740-4f6a-9b38-eed82ca016ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:00.695266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b696857-5740-4f6a-9b38-eed82ca016ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:00.696945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b696857-5740-4f6a-9b38-eed82ca016ac None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:00.710690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 306/616] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:00.716206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b696857-5740-4f6a-9b38-eed82ca016ac None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:00.738636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e73ab-cb4e-432f-b213-3bb63310b117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:00.739454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e73ab-cb4e-432f-b213-3bb63310b117 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:00.739811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e73ab-cb4e-432f-b213-3bb63310b117 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:00.740158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e73ab-cb4e-432f-b213-3bb63310b117 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:00.741247 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e73ab-cb4e-432f-b213-3bb63310b117 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:00.741371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e73ab-cb4e-432f-b213-3bb63310b117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:00.742824 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e73ab-cb4e-432f-b213-3bb63310b117 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:00.772279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 311/617] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:00.777254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e73ab-cb4e-432f-b213-3bb63310b117 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:00.828540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b696857-5740-4f6a-9b38-eed82ca016ac None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:00.846264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:00.868255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44810018-7002-4c67-9508-cee284e1dfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:00.869414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44810018-7002-4c67-9508-cee284e1dfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:00.869943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44810018-7002-4c67-9508-cee284e1dfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:00.870420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44810018-7002-4c67-9508-cee284e1dfc7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:00.879591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44810018-7002-4c67-9508-cee284e1dfc7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:00.881340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44810018-7002-4c67-9508-cee284e1dfc7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-44810018-7002-4c67-9508-cee284e1dfc7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:00.901994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:00.903015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:00.903981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:00.903981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:00.903981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:00.903981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:00.903981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:00.903981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:00.903981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:00.903981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:00.903981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:42:00.903981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:00.910375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 307/618] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:00.918944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44810018-7002-4c67-9508-cee284e1dfc7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:00.982171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e73ab-cb4e-432f-b213-3bb63310b117 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:01.068026 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5aa00-5d61-4595-809f-eeb98b81d72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:01.068895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5aa00-5d61-4595-809f-eeb98b81d72c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:01.069007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5aa00-5d61-4595-809f-eeb98b81d72c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:01.069276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5aa00-5d61-4595-809f-eeb98b81d72c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:01.075182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44810018-7002-4c67-9508-cee284e1dfc7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:01.088746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5aa00-5d61-4595-809f-eeb98b81d72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:01.098494 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5aa00-5d61-4595-809f-eeb98b81d72c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3fc5aa00-5d61-4595-809f-eeb98b81d72c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:01.121021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:01.122140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:01.123693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:01.123693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:01.123693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:01.123693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:01.125462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04b038-644e-4e1f-8dc2-799d1bec764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:01.126427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b038-644e-4e1f-8dc2-799d1bec764f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:01.126924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b038-644e-4e1f-8dc2-799d1bec764f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:01.127393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b038-644e-4e1f-8dc2-799d1bec764f None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:01.128463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04b038-644e-4e1f-8dc2-799d1bec764f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:01.129053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04b038-644e-4e1f-8dc2-799d1bec764f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:01.130771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04b038-644e-4e1f-8dc2-799d1bec764f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:01.137941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 312/619] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:01.142198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5aa00-5d61-4595-809f-eeb98b81d72c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:01.159262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 308/620] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Jun 16 14:42:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:01.165208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04b038-644e-4e1f-8dc2-799d1bec764f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:01.196914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:01.198279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:01.278558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04b038-644e-4e1f-8dc2-799d1bec764f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:01.316869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dda738-64cb-4c2a-919a-ec2107e2c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:01.318205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dda738-64cb-4c2a-919a-ec2107e2c02a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:01.318792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dda738-64cb-4c2a-919a-ec2107e2c02a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:01.319267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dda738-64cb-4c2a-919a-ec2107e2c02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:01.330485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dda738-64cb-4c2a-919a-ec2107e2c02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:01.332191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dda738-64cb-4c2a-919a-ec2107e2c02a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-60dda738-64cb-4c2a-919a-ec2107e2c02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:01.351761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:01.352700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:01.353592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:01.353592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:01.353592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:01.353592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:01.355900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 309/621] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:01.362021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dda738-64cb-4c2a-919a-ec2107e2c02a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:01.398807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5aa00-5d61-4595-809f-eeb98b81d72c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:01.436779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e299d9-7f92-40cc-b7a8-0a54235e6554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:01.437440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e299d9-7f92-40cc-b7a8-0a54235e6554 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:01.437725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e299d9-7f92-40cc-b7a8-0a54235e6554 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:01.438033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e299d9-7f92-40cc-b7a8-0a54235e6554 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:01.439136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e299d9-7f92-40cc-b7a8-0a54235e6554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:01.439379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e299d9-7f92-40cc-b7a8-0a54235e6554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:01.441971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e299d9-7f92-40cc-b7a8-0a54235e6554 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:01.455939 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 313/622] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:01.466151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e299d9-7f92-40cc-b7a8-0a54235e6554 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:01.484495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:01.510705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dda738-64cb-4c2a-919a-ec2107e2c02a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:01.603649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4697d3-4d85-4703-ab17-43ac09d9e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:01.605074 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4697d3-4d85-4703-ab17-43ac09d9e527 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:01.606172 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4697d3-4d85-4703-ab17-43ac09d9e527 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:01.607067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4697d3-4d85-4703-ab17-43ac09d9e527 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:01.608524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4697d3-4d85-4703-ab17-43ac09d9e527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:01.609078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4697d3-4d85-4703-ab17-43ac09d9e527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:01.615136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4697d3-4d85-4703-ab17-43ac09d9e527 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:01.649101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 310/623] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:01.664489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4697d3-4d85-4703-ab17-43ac09d9e527 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:01.678351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:01.727800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e299d9-7f92-40cc-b7a8-0a54235e6554 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:01.803811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc4922-c0c2-4bc3-b6f9-a3bd842bfdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:01.804632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc4922-c0c2-4bc3-b6f9-a3bd842bfdad None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:01.804917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc4922-c0c2-4bc3-b6f9-a3bd842bfdad None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:01.805192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc4922-c0c2-4bc3-b6f9-a3bd842bfdad None admin] PATH_INFO: `/v3/users/glance` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:01.822206 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc4922-c0c2-4bc3-b6f9-a3bd842bfdad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:01.823692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc4922-c0c2-4bc3-b6f9-a3bd842bfdad None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-63bc4922-c0c2-4bc3-b6f9-a3bd842bfdad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:01.847588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:01.848616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:01.849571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:01.849571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:01.849571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:01.849571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:01.849571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:01.849571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:01.849571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:01.849571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:01.849571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:42:01.849571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:01.850698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 314/624] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:01.855389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc4922-c0c2-4bc3-b6f9-a3bd842bfdad None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:01.882375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4697d3-4d85-4703-ab17-43ac09d9e527 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:01.943746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257577-a3c5-4e32-9705-995818dd6357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:01.944979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257577-a3c5-4e32-9705-995818dd6357 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:01.945446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257577-a3c5-4e32-9705-995818dd6357 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:01.945915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257577-a3c5-4e32-9705-995818dd6357 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:01.958674 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257577-a3c5-4e32-9705-995818dd6357 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:01.961319 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257577-a3c5-4e32-9705-995818dd6357 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:01.965715 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-1b257577-a3c5-4e32-9705-995818dd6357 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:01.996613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:01.999298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:02.001426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:02.001426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:02.001426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:02.001426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:02.001426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:02.001426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:02.001426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:02.001426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:02.002473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 311/625] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:02.006028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257577-a3c5-4e32-9705-995818dd6357 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:02.082492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc4922-c0c2-4bc3-b6f9-a3bd842bfdad None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:02.158292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39325f2-a327-4b9c-a28c-30422938172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:02.159439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39325f2-a327-4b9c-a28c-30422938172b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.160564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39325f2-a327-4b9c-a28c-30422938172b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.161148 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39325f2-a327-4b9c-a28c-30422938172b None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.163227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39325f2-a327-4b9c-a28c-30422938172b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:02.163878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39325f2-a327-4b9c-a28c-30422938172b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:02.166326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39325f2-a327-4b9c-a28c-30422938172b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:02.175068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257577-a3c5-4e32-9705-995818dd6357 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:02.189635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:02.213287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 315/626] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Jun 16 14:42:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:02.219089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39325f2-a327-4b9c-a28c-30422938172b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:02.251025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5094dd-a98d-4a11-9a06-1283a319bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:02.251866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5094dd-a98d-4a11-9a06-1283a319bb35 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.252220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5094dd-a98d-4a11-9a06-1283a319bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.252571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5094dd-a98d-4a11-9a06-1283a319bb35 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.254147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5094dd-a98d-4a11-9a06-1283a319bb35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:02.255044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5094dd-a98d-4a11-9a06-1283a319bb35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:02.258745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5094dd-a98d-4a11-9a06-1283a319bb35 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:02.279120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 312/627] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:02.288347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5094dd-a98d-4a11-9a06-1283a319bb35 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:02.386278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:02.425024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39325f2-a327-4b9c-a28c-30422938172b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:02.437984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5094dd-a98d-4a11-9a06-1283a319bb35 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:02.462952 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dac94-6135-480e-803c-ff27dd23aa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:02.463614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dac94-6135-480e-803c-ff27dd23aa15 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.463891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dac94-6135-480e-803c-ff27dd23aa15 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.464159 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dac94-6135-480e-803c-ff27dd23aa15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.489028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef4d5-b50d-46c3-8fc9-b5e1e2dfe9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:02.489965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef4d5-b50d-46c3-8fc9-b5e1e2dfe9b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.490255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef4d5-b50d-46c3-8fc9-b5e1e2dfe9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.490529 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef4d5-b50d-46c3-8fc9-b5e1e2dfe9b1 None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/c0e6fc45641f4c279def2d4aa971978d/roles/6e6c598a68fa410f949be49b804af3f5` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.507848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef4d5-b50d-46c3-8fc9-b5e1e2dfe9b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=c0e6fc45641f4c279def2d4aa971978d, role_id=6e6c598a68fa410f949be49b804af3f5)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:02.509284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef4d5-b50d-46c3-8fc9-b5e1e2dfe9b1 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:02.524030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 313/628] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:02 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/c0e6fc45641f4c279def2d4aa971978d/roles/6e6c598a68fa410f949be49b804af3f5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:02.525718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08012a5-2cf7-484f-9a27-fef10a7c39c5 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.526155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08012a5-2cf7-484f-9a27-fef10a7c39c5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.526579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08012a5-2cf7-484f-9a27-fef10a7c39c5 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.532632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 314/629] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:02.535494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c345d6b-aa70-4eaf-8bae-0a436a75cfff None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.536115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c345d6b-aa70-4eaf-8bae-0a436a75cfff None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.537138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c345d6b-aa70-4eaf-8bae-0a436a75cfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.562999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-1c345d6b-aa70-4eaf-8bae-0a436a75cfff None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:02.564754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1c345d6b-aa70-4eaf-8bae-0a436a75cfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:02.565350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:02.571042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dac94-6135-480e-803c-ff27dd23aa15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:02.572783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dac94-6135-480e-803c-ff27dd23aa15 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:02.666003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 315/630] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:02.667697 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647770-f943-4699-ace3-56920af178f3 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.668387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647770-f943-4699-ace3-56920af178f3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.668549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647770-f943-4699-ace3-56920af178f3 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.675020 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 316/631] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:02.681246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050c1ac-a708-48d1-af1d-9a19086c4c40 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.681581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050c1ac-a708-48d1-af1d-9a19086c4c40 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.681996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050c1ac-a708-48d1-af1d-9a19086c4c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.703352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 316/632] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:02.705414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d34cf2-2d31-4f0b-862e-ecb7082f2029 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.705704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d34cf2-2d31-4f0b-862e-ecb7082f2029 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.706002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d34cf2-2d31-4f0b-862e-ecb7082f2029 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.707308 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 317/633] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:02.708217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d34cf2-2d31-4f0b-862e-ecb7082f2029 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:02.713975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-9050c1ac-a708-48d1-af1d-9a19086c4c40 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:02.715422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9050c1ac-a708-48d1-af1d-9a19086c4c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:02.760651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:02.798882 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 317/634] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:02.800018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050c1ac-a708-48d1-af1d-9a19086c4c40 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:02.828518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:02.835911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d34cf2-2d31-4f0b-862e-ecb7082f2029 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:02.873580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa251057-7cb7-496f-93cc-ff83dc365384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:02.874919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa251057-7cb7-496f-93cc-ff83dc365384 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.875198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa251057-7cb7-496f-93cc-ff83dc365384 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.875473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa251057-7cb7-496f-93cc-ff83dc365384 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.886246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa251057-7cb7-496f-93cc-ff83dc365384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-aa251057-7cb7-496f-93cc-ff83dc365384 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:02.895153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:02.896121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:02.896956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 318/635] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:42:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:02.898078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66a476-0060-4ad6-a703-564e12939053 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.898078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66a476-0060-4ad6-a703-564e12939053 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.898198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66a476-0060-4ad6-a703-564e12939053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.915593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ff66a476-0060-4ad6-a703-564e12939053 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:02.916885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ff66a476-0060-4ad6-a703-564e12939053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:02.918074 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050c1ac-a708-48d1-af1d-9a19086c4c40 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:02.957206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410ac7d-6efd-42b9-a2b9-f07e08e27eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:02.957942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ac7d-6efd-42b9-a2b9-f07e08e27eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.958224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ac7d-6efd-42b9-a2b9-f07e08e27eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.958496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ac7d-6efd-42b9-a2b9-f07e08e27eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.969123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410ac7d-6efd-42b9-a2b9-f07e08e27eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:02.970627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410ac7d-6efd-42b9-a2b9-f07e08e27eb1 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:02.989957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 319/636] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:02.989957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66a476-0060-4ad6-a703-564e12939053 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-f410ac7d-6efd-42b9-a2b9-f07e08e27eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:02.990240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:02.991025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:02.991889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:02.991889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:02.991889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:02.991889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:02.995459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 318/637] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:02.996266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410ac7d-6efd-42b9-a2b9-f07e08e27eb1 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.024642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.091258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.104783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66a476-0060-4ad6-a703-564e12939053 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.116624 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410ac7d-6efd-42b9-a2b9-f07e08e27eb1 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.143760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6ec41-96bc-4797-adda-f010fc79b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.144695 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ec41-96bc-4797-adda-f010fc79b4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.145102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ec41-96bc-4797-adda-f010fc79b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.145381 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ec41-96bc-4797-adda-f010fc79b4f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.152672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d1a09-6550-4bc7-994d-edbea71dd13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.153339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d1a09-6550-4bc7-994d-edbea71dd13c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.153622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d1a09-6550-4bc7-994d-edbea71dd13c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.153903 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d1a09-6550-4bc7-994d-edbea71dd13c None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.155460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d1a09-6550-4bc7-994d-edbea71dd13c None admin] RBAC: Adding query filter params (name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:03.155912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d1a09-6550-4bc7-994d-edbea71dd13c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.156609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6ec41-96bc-4797-adda-f010fc79b4f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:03.157287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d1a09-6550-4bc7-994d-edbea71dd13c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-cbc6ec41-96bc-4797-adda-f010fc79b4f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:03.164973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:03.165924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 320/638] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:42:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:03.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6ec41-96bc-4797-adda-f010fc79b4f1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.173048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 319/639] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:42:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:03.173048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d1a09-6550-4bc7-994d-edbea71dd13c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.272813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.286735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6ec41-96bc-4797-adda-f010fc79b4f1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.291458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d1a09-6550-4bc7-994d-edbea71dd13c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.322127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962150bd-fcd9-4034-b5b2-85e1843a7f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.322801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962150bd-fcd9-4034-b5b2-85e1843a7f32 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.323084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962150bd-fcd9-4034-b5b2-85e1843a7f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.323361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962150bd-fcd9-4034-b5b2-85e1843a7f32 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.324084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962150bd-fcd9-4034-b5b2-85e1843a7f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:03.324393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962150bd-fcd9-4034-b5b2-85e1843a7f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.325757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962150bd-fcd9-4034-b5b2-85e1843a7f32 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.329234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417d4b4-7d16-4ca2-83f5-f960f18a84d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.330086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d4b4-7d16-4ca2-83f5-f960f18a84d5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.330372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d4b4-7d16-4ca2-83f5-f960f18a84d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.330650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d4b4-7d16-4ca2-83f5-f960f18a84d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.343143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417d4b4-7d16-4ca2-83f5-f960f18a84d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:03.349766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 321/640] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:03.349766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962150bd-fcd9-4034-b5b2-85e1843a7f32 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-8417d4b4-7d16-4ca2-83f5-f960f18a84d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:03.351375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:03.352580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 320/641] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:03.354614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417d4b4-7d16-4ca2-83f5-f960f18a84d5 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.366553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.481139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962150bd-fcd9-4034-b5b2-85e1843a7f32 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.492708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417d4b4-7d16-4ca2-83f5-f960f18a84d5 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.519040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ec9b1-53f3-4235-bf91-f652be326274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.519931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ec9b1-53f3-4235-bf91-f652be326274 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.520264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ec9b1-53f3-4235-bf91-f652be326274 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.520612 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ec9b1-53f3-4235-bf91-f652be326274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.528122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709bfdb-7fd8-4675-b8b2-758fff600bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.528938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709bfdb-7fd8-4675-b8b2-758fff600bcf None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.529048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709bfdb-7fd8-4675-b8b2-758fff600bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.529284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709bfdb-7fd8-4675-b8b2-758fff600bcf None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.530056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709bfdb-7fd8-4675-b8b2-758fff600bcf None admin] RBAC: Adding query filter params (name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:03.530367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709bfdb-7fd8-4675-b8b2-758fff600bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.531518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ec9b1-53f3-4235-bf91-f652be326274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.531731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709bfdb-7fd8-4675-b8b2-758fff600bcf None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.532928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ec9b1-53f3-4235-bf91-f652be326274 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.540473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 321/642] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:03.541566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709bfdb-7fd8-4675-b8b2-758fff600bcf None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.553970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d38ec9b1-53f3-4235-bf91-f652be326274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:03.555261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:03.562316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:03.563243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:03.563243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:03.563243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:03.563243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:03.563243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 322/643] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:03.563243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ec9b1-53f3-4235-bf91-f652be326274 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.625670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.669666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709bfdb-7fd8-4675-b8b2-758fff600bcf None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.682479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ec9b1-53f3-4235-bf91-f652be326274 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.705796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cd0d1-b164-48a9-b15e-03d13a984909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.706622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd0d1-b164-48a9-b15e-03d13a984909 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.706908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd0d1-b164-48a9-b15e-03d13a984909 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.707185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd0d1-b164-48a9-b15e-03d13a984909 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.714323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cd0d1-b164-48a9-b15e-03d13a984909 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.715766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cd0d1-b164-48a9-b15e-03d13a984909 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.719175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2244-ce68-4f9e-98b5-2cb22dd488fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.720090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2244-ce68-4f9e-98b5-2cb22dd488fe None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.720507 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2244-ce68-4f9e-98b5-2cb22dd488fe None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.720790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2244-ce68-4f9e-98b5-2cb22dd488fe None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.721539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2244-ce68-4f9e-98b5-2cb22dd488fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:03.721850 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2244-ce68-4f9e-98b5-2cb22dd488fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.723288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2244-ce68-4f9e-98b5-2cb22dd488fe None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-688cd0d1-b164-48a9-b15e-03d13a984909 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:03.730793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:03.731683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:03.737541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:03.737541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:03.737541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:03.737541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:03.737541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:03.737541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:03.737541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:03.737541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:03.738433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 323/644] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:03.738433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2244-ce68-4f9e-98b5-2cb22dd488fe None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.738562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 322/645] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:03.738562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cd0d1-b164-48a9-b15e-03d13a984909 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.808278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.845607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2244-ce68-4f9e-98b5-2cb22dd488fe None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.848883 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cd0d1-b164-48a9-b15e-03d13a984909 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.871012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.883990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c3b68-dae6-4c3c-9f10-20284c74f567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.884891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c3b68-dae6-4c3c-9f10-20284c74f567 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.885178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c3b68-dae6-4c3c-9f10-20284c74f567 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.885454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c3b68-dae6-4c3c-9f10-20284c74f567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.886863 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef803f3-e5ab-4987-88a5-ec6c4490eb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.887784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef803f3-e5ab-4987-88a5-ec6c4490eb6b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.888068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef803f3-e5ab-4987-88a5-ec6c4490eb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.888350 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef803f3-e5ab-4987-88a5-ec6c4490eb6b None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.889100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef803f3-e5ab-4987-88a5-ec6c4490eb6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:03.889405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef803f3-e5ab-4987-88a5-ec6c4490eb6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.890801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef803f3-e5ab-4987-88a5-ec6c4490eb6b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.897795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c3b68-dae6-4c3c-9f10-20284c74f567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.899247 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c3b68-dae6-4c3c-9f10-20284c74f567 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.908051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 323/646] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:03.908051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef803f3-e5ab-4987-88a5-ec6c4490eb6b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-8d6c3b68-dae6-4c3c-9f10-20284c74f567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:03.919395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:03.921086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:03.922001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:03.922001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:03.922001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:03.922001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:03.926080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 324/647] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:03.926947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c3b68-dae6-4c3c-9f10-20284c74f567 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.026531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef803f3-e5ab-4987-88a5-ec6c4490eb6b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.041697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c3b68-dae6-4c3c-9f10-20284c74f567 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.054163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:04.065215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aee1ab-00c5-4f13-8bd9-8034a4bb8ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.066082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aee1ab-00c5-4f13-8bd9-8034a4bb8ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.066483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aee1ab-00c5-4f13-8bd9-8034a4bb8ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.066760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aee1ab-00c5-4f13-8bd9-8034a4bb8ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.077437 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad539e7-7b44-496b-8587-22cbeab0159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.078140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad539e7-7b44-496b-8587-22cbeab0159d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.078427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad539e7-7b44-496b-8587-22cbeab0159d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.078702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad539e7-7b44-496b-8587-22cbeab0159d None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.079420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aee1ab-00c5-4f13-8bd9-8034a4bb8ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.079522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad539e7-7b44-496b-8587-22cbeab0159d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:04.079788 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad539e7-7b44-496b-8587-22cbeab0159d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.080890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aee1ab-00c5-4f13-8bd9-8034a4bb8ee5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.081201 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad539e7-7b44-496b-8587-22cbeab0159d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.098614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 325/648] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:04.098614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad539e7-7b44-496b-8587-22cbeab0159d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-a8aee1ab-00c5-4f13-8bd9-8034a4bb8ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:04.099403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:04.100258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:04.101139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:04.101139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:04.101139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:04.101139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:04.101139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 324/649] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:04.101814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aee1ab-00c5-4f13-8bd9-8034a4bb8ee5 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.140473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:04.213084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aee1ab-00c5-4f13-8bd9-8034a4bb8ee5 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.216120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad539e7-7b44-496b-8587-22cbeab0159d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.255923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f75fe-1466-435a-8a03-be5b2530d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.256769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f75fe-1466-435a-8a03-be5b2530d973 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.257409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e586b-0c57-4ea6-932f-bd64cbfac054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.258337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e586b-0c57-4ea6-932f-bd64cbfac054 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.258626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e586b-0c57-4ea6-932f-bd64cbfac054 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.258910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e586b-0c57-4ea6-932f-bd64cbfac054 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.259069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f75fe-1466-435a-8a03-be5b2530d973 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.259329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f75fe-1466-435a-8a03-be5b2530d973 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.260065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f75fe-1466-435a-8a03-be5b2530d973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:04.260380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f75fe-1466-435a-8a03-be5b2530d973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.261775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f75fe-1466-435a-8a03-be5b2530d973 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.267406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e586b-0c57-4ea6-932f-bd64cbfac054 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.268835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e586b-0c57-4ea6-932f-bd64cbfac054 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.275093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 325/650] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:04.275743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f75fe-1466-435a-8a03-be5b2530d973 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-913e586b-0c57-4ea6-932f-bd64cbfac054 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:04.289007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:04.290038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:04.290987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:04.290987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:04.290987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:04.290987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:04.290987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:04.290987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:04.290987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:04.290987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:04.290987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:04.290987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:04.290987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 326/651] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Jun 16 14:42:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:04.291577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e586b-0c57-4ea6-932f-bd64cbfac054 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.327307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:04.393877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f75fe-1466-435a-8a03-be5b2530d973 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.394295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:04.402691 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e586b-0c57-4ea6-932f-bd64cbfac054 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.432458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aefb65-2920-4dc2-bd5e-fbee28bb6da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.433116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aefb65-2920-4dc2-bd5e-fbee28bb6da2 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.433397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aefb65-2920-4dc2-bd5e-fbee28bb6da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.433674 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aefb65-2920-4dc2-bd5e-fbee28bb6da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.434531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aefb65-2920-4dc2-bd5e-fbee28bb6da2 None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=cb9c1cc51e544c90a629feb312a80c71) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:04.434845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aefb65-2920-4dc2-bd5e-fbee28bb6da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.436502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aefb65-2920-4dc2-bd5e-fbee28bb6da2 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.440152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf9c4d-4805-410d-97ad-5336e6796719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.440813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf9c4d-4805-410d-97ad-5336e6796719 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.441101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf9c4d-4805-410d-97ad-5336e6796719 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.441573 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf9c4d-4805-410d-97ad-5336e6796719 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.442326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf9c4d-4805-410d-97ad-5336e6796719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:04.442638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf9c4d-4805-410d-97ad-5336e6796719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.443372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 326/652] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:04 2022] GET /identity/v3/role_assignments?user.id=cb9c1cc51e544c90a629feb312a80c71&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:04.443986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aefb65-2920-4dc2-bd5e-fbee28bb6da2 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.448278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf9c4d-4805-410d-97ad-5336e6796719 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.466301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 327/653] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:04.468092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf9c4d-4805-410d-97ad-5336e6796719 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.590201 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aefb65-2920-4dc2-bd5e-fbee28bb6da2 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.593433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:04.606966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf9c4d-4805-410d-97ad-5336e6796719 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.642025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24284039-2920-4396-b6ab-9b3a5b9bc372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.643571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284039-2920-4396-b6ab-9b3a5b9bc372 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.644299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284039-2920-4396-b6ab-9b3a5b9bc372 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.645321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284039-2920-4396-b6ab-9b3a5b9bc372 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.656280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24284039-2920-4396-b6ab-9b3a5b9bc372 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.658391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24284039-2920-4396-b6ab-9b3a5b9bc372 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.666843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d988cf7-4304-43cc-ab3b-65263d2119a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.667548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d988cf7-4304-43cc-ab3b-65263d2119a1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.668064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d988cf7-4304-43cc-ab3b-65263d2119a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.668497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d988cf7-4304-43cc-ab3b-65263d2119a1 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.669369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d988cf7-4304-43cc-ab3b-65263d2119a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:04.669687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d988cf7-4304-43cc-ab3b-65263d2119a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.671629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d988cf7-4304-43cc-ab3b-65263d2119a1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-24284039-2920-4396-b6ab-9b3a5b9bc372 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:04.677938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:04.679243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:04.680173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:04.680173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:04.680173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:04.680173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:04.680173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:04.680173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:04.680173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:04.680173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:04.680173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:42:04.680173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:04.680173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 327/654] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:04.680760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24284039-2920-4396-b6ab-9b3a5b9bc372 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.702609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 328/655] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Jun 16 14:42:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:04.703531 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d988cf7-4304-43cc-ab3b-65263d2119a1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.720775 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:04.796015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24284039-2920-4396-b6ab-9b3a5b9bc372 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.821550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d988cf7-4304-43cc-ab3b-65263d2119a1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.830999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee87198-0074-4475-952f-f82c8fa709d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.831808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee87198-0074-4475-952f-f82c8fa709d3 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.832089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee87198-0074-4475-952f-f82c8fa709d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.832364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee87198-0074-4475-952f-f82c8fa709d3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.840396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee87198-0074-4475-952f-f82c8fa709d3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.841852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee87198-0074-4475-952f-f82c8fa709d3 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-3ee87198-0074-4475-952f-f82c8fa709d3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:04.856733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:04.858621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 328/656] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:42:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:04.859535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee87198-0074-4475-952f-f82c8fa709d3 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.864158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4050a-5647-4867-bd58-c26129b89ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.865061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4050a-5647-4867-bd58-c26129b89ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.865542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4050a-5647-4867-bd58-c26129b89ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.866022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4050a-5647-4867-bd58-c26129b89ba3 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.867049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4050a-5647-4867-bd58-c26129b89ba3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:04.867364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4050a-5647-4867-bd58-c26129b89ba3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.868829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4050a-5647-4867-bd58-c26129b89ba3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.888391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:04.890024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 329/657] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Jun 16 14:42:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:04.891601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef346c-72d8-42b8-9668-e80dc175e49d None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.891993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef346c-72d8-42b8-9668-e80dc175e49d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.892167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef346c-72d8-42b8-9668-e80dc175e49d None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.897549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 330/658] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:04.897549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef346c-72d8-42b8-9668-e80dc175e49d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.971943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:04.981463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee87198-0074-4475-952f-f82c8fa709d3 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:05.006665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef346c-72d8-42b8-9668-e80dc175e49d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:05.016675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861835c-24a6-48e5-8b15-fd64a37ed2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:05.017415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861835c-24a6-48e5-8b15-fd64a37ed2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:05.017700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861835c-24a6-48e5-8b15-fd64a37ed2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:05.018011 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861835c-24a6-48e5-8b15-fd64a37ed2d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:05.044442 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4180f-9f9f-4884-8d44-dff2366df1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:05.045689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4180f-9f9f-4884-8d44-dff2366df1cb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:05.046002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4180f-9f9f-4884-8d44-dff2366df1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:05.046280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4180f-9f9f-4884-8d44-dff2366df1cb None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:05.047111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4180f-9f9f-4884-8d44-dff2366df1cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:05.047434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4180f-9f9f-4884-8d44-dff2366df1cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:05.048899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4180f-9f9f-4884-8d44-dff2366df1cb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:05.068282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 331/659] 10.222.0.81 () {56 vars in 1139 bytes} [Thu Jun 16 14:42:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:05.069206 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4180f-9f9f-4884-8d44-dff2366df1cb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:05.097567 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861835c-24a6-48e5-8b15-fd64a37ed2d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:05.099330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861835c-24a6-48e5-8b15-fd64a37ed2d8 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:05.124585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:05.178260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4180f-9f9f-4884-8d44-dff2366df1cb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:05.209983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:05.217358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 329/660] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:05.218828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85c3e-0632-4737-83b0-0904f02a3a11 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:05.219165 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85c3e-0632-4737-83b0-0904f02a3a11 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:05.219501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85c3e-0632-4737-83b0-0904f02a3a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:05.219681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587204e-5798-40c6-93d0-e14b05e7d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:05.220331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587204e-5798-40c6-93d0-e14b05e7d5be None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:05.220611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587204e-5798-40c6-93d0-e14b05e7d5be None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:05.220880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587204e-5798-40c6-93d0-e14b05e7d5be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:05.240485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c5d85c3e-0632-4737-83b0-0904f02a3a11 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:05.242123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c5d85c3e-0632-4737-83b0-0904f02a3a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:05.300213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587204e-5798-40c6-93d0-e14b05e7d5be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:05.301976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587204e-5798-40c6-93d0-e14b05e7d5be None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:05.330317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 330/661] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:05.331515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d85c3e-0632-4737-83b0-0904f02a3a11 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:05.395449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:05.414844 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 332/662] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:05.415698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587204e-5798-40c6-93d0-e14b05e7d5be None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:05.449287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:05.451673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d85c3e-0632-4737-83b0-0904f02a3a11 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:05.488492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c9736-b10e-4b59-8abf-108ee767e338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:05.489141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c9736-b10e-4b59-8abf-108ee767e338 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:05.489419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c9736-b10e-4b59-8abf-108ee767e338 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:05.489687 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c9736-b10e-4b59-8abf-108ee767e338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:05.528592 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587204e-5798-40c6-93d0-e14b05e7d5be None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:05.562903 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c9736-b10e-4b59-8abf-108ee767e338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:05.564363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c9736-b10e-4b59-8abf-108ee767e338 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:05.565686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6c15d-e815-4bb6-97a2-16c8f57aaadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:05.566703 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6c15d-e815-4bb6-97a2-16c8f57aaadf None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:05.567769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6c15d-e815-4bb6-97a2-16c8f57aaadf None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:05.568056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6c15d-e815-4bb6-97a2-16c8f57aaadf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:05.580440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6c15d-e815-4bb6-97a2-16c8f57aaadf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:05.581945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6c15d-e815-4bb6-97a2-16c8f57aaadf None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-70e6c15d-e815-4bb6-97a2-16c8f57aaadf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:05.601522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:05.602791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:05.604211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:05.604211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:05.604211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:05.604211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:05.607994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 333/663] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:05.608740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6c15d-e815-4bb6-97a2-16c8f57aaadf None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:05.621583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:05.691358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 331/664] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:05.692075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c9736-b10e-4b59-8abf-108ee767e338 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:05.715261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:05.738245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6c15d-e815-4bb6-97a2-16c8f57aaadf None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:05.775728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226e75c-fda4-46df-b971-228337f9770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:05.776537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e75c-fda4-46df-b971-228337f9770e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:05.776815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e75c-fda4-46df-b971-228337f9770e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:05.777331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e75c-fda4-46df-b971-228337f9770e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:05.788112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226e75c-fda4-46df-b971-228337f9770e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-8226e75c-fda4-46df-b971-228337f9770e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:05.796448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:05.797422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:05.798666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:05.799305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c9736-b10e-4b59-8abf-108ee767e338 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:05.799390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 334/665] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:05.799390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226e75c-fda4-46df-b971-228337f9770e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:05.847349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dd2ac-4cdd-4b03-ba8b-a3df48bd5bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:05.848960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dd2ac-4cdd-4b03-ba8b-a3df48bd5bbf None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:05.849468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dd2ac-4cdd-4b03-ba8b-a3df48bd5bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:05.849985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dd2ac-4cdd-4b03-ba8b-a3df48bd5bbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:05.861325 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6dd2ac-4cdd-4b03-ba8b-a3df48bd5bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:05.862812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6dd2ac-4cdd-4b03-ba8b-a3df48bd5bbf None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-2d6dd2ac-4cdd-4b03-ba8b-a3df48bd5bbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:05.881962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:05.882897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:05.883789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:05.883789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:05.883789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:05.883789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:05.883789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 332/666] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:05.884873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dd2ac-4cdd-4b03-ba8b-a3df48bd5bbf None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:05.889721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:05.909207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226e75c-fda4-46df-b971-228337f9770e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:05.950584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02a6cc-367c-430c-8d73-6e9ecbc038c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:05.951357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02a6cc-367c-430c-8d73-6e9ecbc038c0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:05.951733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02a6cc-367c-430c-8d73-6e9ecbc038c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:05.952068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02a6cc-367c-430c-8d73-6e9ecbc038c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:05.952955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02a6cc-367c-430c-8d73-6e9ecbc038c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:05.953326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02a6cc-367c-430c-8d73-6e9ecbc038c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:05.955036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02a6cc-367c-430c-8d73-6e9ecbc038c0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:05.966060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:05.974705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 335/667] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:05.974705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02a6cc-367c-430c-8d73-6e9ecbc038c0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.026236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dd2ac-4cdd-4b03-ba8b-a3df48bd5bbf None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.063961 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f84cc-3259-4726-a8e3-48f878ab2b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.065220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f84cc-3259-4726-a8e3-48f878ab2b89 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.065505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f84cc-3259-4726-a8e3-48f878ab2b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.065781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f84cc-3259-4726-a8e3-48f878ab2b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.077999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f84cc-3259-4726-a8e3-48f878ab2b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:06.079453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f84cc-3259-4726-a8e3-48f878ab2b89 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:06.090960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02a6cc-367c-430c-8d73-6e9ecbc038c0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-646f84cc-3259-4726-a8e3-48f878ab2b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:06.097911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:06.098790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:06.104042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:06.104042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:06.104042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:06.104042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:06.104042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 333/668] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:06.104042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f84cc-3259-4726-a8e3-48f878ab2b89 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.136173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515ea2d-0236-4c90-9b93-6734b06b7ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.137098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515ea2d-0236-4c90-9b93-6734b06b7ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.137657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515ea2d-0236-4c90-9b93-6734b06b7ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.137937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515ea2d-0236-4c90-9b93-6734b06b7ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.139262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515ea2d-0236-4c90-9b93-6734b06b7ca3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:06.139710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515ea2d-0236-4c90-9b93-6734b06b7ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:06.141660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515ea2d-0236-4c90-9b93-6734b06b7ca3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:06.154628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 336/669] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:06.154628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515ea2d-0236-4c90-9b93-6734b06b7ca3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.173357 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:06.222665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:06.222849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f84cc-3259-4726-a8e3-48f878ab2b89 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.260024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c9df2-7106-41a5-9012-92f16401a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.260692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9df2-7106-41a5-9012-92f16401a607 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.260974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9df2-7106-41a5-9012-92f16401a607 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.261247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9df2-7106-41a5-9012-92f16401a607 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.262002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c9df2-7106-41a5-9012-92f16401a607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:06.262313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c9df2-7106-41a5-9012-92f16401a607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:06.264469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c9df2-7106-41a5-9012-92f16401a607 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:06.266003 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515ea2d-0236-4c90-9b93-6734b06b7ca3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.280719 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 334/670] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:06.280719 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c9df2-7106-41a5-9012-92f16401a607 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.306103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0629d25-825e-4420-adae-b0e30a0c93b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.306906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0629d25-825e-4420-adae-b0e30a0c93b5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.307182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0629d25-825e-4420-adae-b0e30a0c93b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.307449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0629d25-825e-4420-adae-b0e30a0c93b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.315280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0629d25-825e-4420-adae-b0e30a0c93b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:06.316749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0629d25-825e-4420-adae-b0e30a0c93b5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-e0629d25-825e-4420-adae-b0e30a0c93b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:06.341010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:06.342830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:06.343715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:06.343715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:06.343715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:06.343715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:06.343715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:06.343715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:06.343715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:06.343715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:06.346339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 337/671] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:06.347469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0629d25-825e-4420-adae-b0e30a0c93b5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.400214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c9df2-7106-41a5-9012-92f16401a607 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.418290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:06.445385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357366e2-141d-4300-b336-6fb367580885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.446264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357366e2-141d-4300-b336-6fb367580885 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.446548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357366e2-141d-4300-b336-6fb367580885 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.446822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357366e2-141d-4300-b336-6fb367580885 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.447545 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357366e2-141d-4300-b336-6fb367580885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:06.447852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357366e2-141d-4300-b336-6fb367580885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:06.449228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357366e2-141d-4300-b336-6fb367580885 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:06.457711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0629d25-825e-4420-adae-b0e30a0c93b5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.462804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 335/672] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:06.463799 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357366e2-141d-4300-b336-6fb367580885 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.485565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:06.499044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d36a35-5843-4401-8a99-e3c7f22b90b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.499826 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36a35-5843-4401-8a99-e3c7f22b90b2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.500112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36a35-5843-4401-8a99-e3c7f22b90b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.500384 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36a35-5843-4401-8a99-e3c7f22b90b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.510944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d36a35-5843-4401-8a99-e3c7f22b90b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:06.512707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d36a35-5843-4401-8a99-e3c7f22b90b2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-e4d36a35-5843-4401-8a99-e3c7f22b90b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:06.533469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:06.534449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:06.535894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:06.535894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:06.535894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:06.535894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:06.535894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 338/673] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:06.535894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d36a35-5843-4401-8a99-e3c7f22b90b2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.576934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357366e2-141d-4300-b336-6fb367580885 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.616564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da096aa-d371-4c27-a54d-9444c786d78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.617367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da096aa-d371-4c27-a54d-9444c786d78a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.617652 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da096aa-d371-4c27-a54d-9444c786d78a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.618022 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da096aa-d371-4c27-a54d-9444c786d78a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.627264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da096aa-d371-4c27-a54d-9444c786d78a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:06.628716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da096aa-d371-4c27-a54d-9444c786d78a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-8da096aa-d371-4c27-a54d-9444c786d78a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:06.645579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:06.646681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:06.647593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:06.647593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:06.647593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:06.647593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:06.647593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:06.647593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:06.647593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:06.647593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:06.647593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 336/674] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:06.648071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da096aa-d371-4c27-a54d-9444c786d78a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.661708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d36a35-5843-4401-8a99-e3c7f22b90b2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.699600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:06.712404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d197494-0ef1-4e56-b42a-0456a6fadf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.713179 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d197494-0ef1-4e56-b42a-0456a6fadf0a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.713453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d197494-0ef1-4e56-b42a-0456a6fadf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.713991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d197494-0ef1-4e56-b42a-0456a6fadf0a None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.714650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d197494-0ef1-4e56-b42a-0456a6fadf0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:06.714957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d197494-0ef1-4e56-b42a-0456a6fadf0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:06.717680 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d197494-0ef1-4e56-b42a-0456a6fadf0a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:06.729054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 339/675] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:06.729787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d197494-0ef1-4e56-b42a-0456a6fadf0a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.765277 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:06.778273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da096aa-d371-4c27-a54d-9444c786d78a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.814073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dc2f3-9075-4f87-a9d8-08a5e521cad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.814976 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc2f3-9075-4f87-a9d8-08a5e521cad2 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.815302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc2f3-9075-4f87-a9d8-08a5e521cad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.815620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc2f3-9075-4f87-a9d8-08a5e521cad2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.823728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dc2f3-9075-4f87-a9d8-08a5e521cad2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:06.825381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dc2f3-9075-4f87-a9d8-08a5e521cad2 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:06.831371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d197494-0ef1-4e56-b42a-0456a6fadf0a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-f23dc2f3-9075-4f87-a9d8-08a5e521cad2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:06.842486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:06.843467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:06.844437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:06.844437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:06.844437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:06.844437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:06.844437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:06.844437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:06.844437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:06.844437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:06.844437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 337/676] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:06.844954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dc2f3-9075-4f87-a9d8-08a5e521cad2 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.869138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf00ab2-4a77-44b3-8851-478f9e69d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.869811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf00ab2-4a77-44b3-8851-478f9e69d7bc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.870136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf00ab2-4a77-44b3-8851-478f9e69d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.870417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf00ab2-4a77-44b3-8851-478f9e69d7bc None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.871228 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf00ab2-4a77-44b3-8851-478f9e69d7bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:06.871577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf00ab2-4a77-44b3-8851-478f9e69d7bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:06.873685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf00ab2-4a77-44b3-8851-478f9e69d7bc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:06.887059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 340/677] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:06.888284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf00ab2-4a77-44b3-8851-478f9e69d7bc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.945706 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:06.952868 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dc2f3-9075-4f87-a9d8-08a5e521cad2 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.983874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:06.987632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912073b7-b3f5-486b-a5e3-f75e6a51acff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.988308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912073b7-b3f5-486b-a5e3-f75e6a51acff None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.990423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912073b7-b3f5-486b-a5e3-f75e6a51acff None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.990722 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912073b7-b3f5-486b-a5e3-f75e6a51acff None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.990983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf00ab2-4a77-44b3-8851-478f9e69d7bc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.991520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912073b7-b3f5-486b-a5e3-f75e6a51acff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:06.991830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912073b7-b3f5-486b-a5e3-f75e6a51acff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:06.993262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912073b7-b3f5-486b-a5e3-f75e6a51acff None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.006091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 338/678] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:07.007363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3c679-7952-4577-9ff3-9cb242bd0bc6 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.007656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3c679-7952-4577-9ff3-9cb242bd0bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.007937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3c679-7952-4577-9ff3-9cb242bd0bc6 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.009285 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 339/679] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:07.009853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3c679-7952-4577-9ff3-9cb242bd0bc6 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.030812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30416548-31c4-40ef-8bc7-e08163554550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.031394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416548-31c4-40ef-8bc7-e08163554550 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.031676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416548-31c4-40ef-8bc7-e08163554550 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.031952 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416548-31c4-40ef-8bc7-e08163554550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.032780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30416548-31c4-40ef-8bc7-e08163554550 None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=f2faa046b0294a0ba1090be84bb1cebc) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:07.033092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30416548-31c4-40ef-8bc7-e08163554550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.034609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30416548-31c4-40ef-8bc7-e08163554550 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.040581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 341/680] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/role_assignments?user.id=f2faa046b0294a0ba1090be84bb1cebc&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:07.041352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30416548-31c4-40ef-8bc7-e08163554550 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.132105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3c679-7952-4577-9ff3-9cb242bd0bc6 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.160822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30416548-31c4-40ef-8bc7-e08163554550 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.173162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1af56c-6b72-4602-b849-9afea64fb6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.173978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1af56c-6b72-4602-b849-9afea64fb6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.174262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1af56c-6b72-4602-b849-9afea64fb6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.174543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1af56c-6b72-4602-b849-9afea64fb6a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.175334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1af56c-6b72-4602-b849-9afea64fb6a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:07.175647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1af56c-6b72-4602-b849-9afea64fb6a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.177326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1af56c-6b72-4602-b849-9afea64fb6a1 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.196404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 340/681] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:07.197617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1af56c-6b72-4602-b849-9afea64fb6a1 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.198708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52c534-d47d-4dc8-a21d-5854a0beb5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.199521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52c534-d47d-4dc8-a21d-5854a0beb5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.199807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52c534-d47d-4dc8-a21d-5854a0beb5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.200094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52c534-d47d-4dc8-a21d-5854a0beb5a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.209297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52c534-d47d-4dc8-a21d-5854a0beb5a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.210800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52c534-d47d-4dc8-a21d-5854a0beb5a7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.219873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-6d52c534-d47d-4dc8-a21d-5854a0beb5a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:07.228349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:07.229332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:07.230307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:07.230307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:07.230307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:07.230307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:07.230307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:07.230307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:07.230307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:07.230307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:07.230307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:42:07.230307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:07.230307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 342/682] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:07.231571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075702-cf3c-40e1-b8f8-8bbf15bd6431 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.231859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075702-cf3c-40e1-b8f8-8bbf15bd6431 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.232134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075702-cf3c-40e1-b8f8-8bbf15bd6431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.249888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-47075702-cf3c-40e1-b8f8-8bbf15bd6431 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:07.251138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-47075702-cf3c-40e1-b8f8-8bbf15bd6431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:07.267430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:07.318232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1af56c-6b72-4602-b849-9afea64fb6a1 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.330369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 343/683] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:07.331316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075702-cf3c-40e1-b8f8-8bbf15bd6431 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.371895 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6f3ac-a120-47d4-affe-8f2653850c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.372559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6f3ac-a120-47d4-affe-8f2653850c37 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.373368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6f3ac-a120-47d4-affe-8f2653850c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.373645 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6f3ac-a120-47d4-affe-8f2653850c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.374495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6f3ac-a120-47d4-affe-8f2653850c37 None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=c41347251cac48c3a2ee7fa6d2fe4cbb) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:07.374801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6f3ac-a120-47d4-affe-8f2653850c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.376237 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6f3ac-a120-47d4-affe-8f2653850c37 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.382825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 341/684] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/role_assignments?user.id=c41347251cac48c3a2ee7fa6d2fe4cbb&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:07.390935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6f3ac-a120-47d4-affe-8f2653850c37 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.455717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075702-cf3c-40e1-b8f8-8bbf15bd6431 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.497338 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca752f8-dcc7-4635-b711-e3ea69348695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.498614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca752f8-dcc7-4635-b711-e3ea69348695 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.498898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca752f8-dcc7-4635-b711-e3ea69348695 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.499267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca752f8-dcc7-4635-b711-e3ea69348695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.500144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca752f8-dcc7-4635-b711-e3ea69348695 None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=8940bddd49534f01a8b1bf1dee644216) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:07.500463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca752f8-dcc7-4635-b711-e3ea69348695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.502779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca752f8-dcc7-4635-b711-e3ea69348695 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.509571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 344/685] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/role_assignments?user.id=8940bddd49534f01a8b1bf1dee644216&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:07.510570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca752f8-dcc7-4635-b711-e3ea69348695 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.518149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:07.531545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:07.549723 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6f3ac-a120-47d4-affe-8f2653850c37 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.599134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b148dd-e32b-48ef-b8ef-26598a0909db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.599876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b148dd-e32b-48ef-b8ef-26598a0909db None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.600218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b148dd-e32b-48ef-b8ef-26598a0909db None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.600551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b148dd-e32b-48ef-b8ef-26598a0909db None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.601589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b148dd-e32b-48ef-b8ef-26598a0909db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:07.601988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b148dd-e32b-48ef-b8ef-26598a0909db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.604465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b148dd-e32b-48ef-b8ef-26598a0909db None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.637850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 342/686] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:07.644813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b148dd-e32b-48ef-b8ef-26598a0909db None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.707239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca752f8-dcc7-4635-b711-e3ea69348695 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.756774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b380c-fde6-4370-88c4-22263ba9ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.758297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b380c-fde6-4370-88c4-22263ba9ef85 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.758976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b380c-fde6-4370-88c4-22263ba9ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.759415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b380c-fde6-4370-88c4-22263ba9ef85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.774714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b380c-fde6-4370-88c4-22263ba9ef85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.777228 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b380c-fde6-4370-88c4-22263ba9ef85 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.783618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b148dd-e32b-48ef-b8ef-26598a0909db None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-181b380c-fde6-4370-88c4-22263ba9ef85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:07.801263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:07.802406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:07.803488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:07.803488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:07.803488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:07.803488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:07.805823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 345/687] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:07.811889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b380c-fde6-4370-88c4-22263ba9ef85 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.827838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b1eb1-7511-4837-a777-221db0e90f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.828929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b1eb1-7511-4837-a777-221db0e90f56 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.829739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b1eb1-7511-4837-a777-221db0e90f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.830139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b1eb1-7511-4837-a777-221db0e90f56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.840116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:07.895937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:07.911415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b1eb1-7511-4837-a777-221db0e90f56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.913159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b1eb1-7511-4837-a777-221db0e90f56 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.938685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b380c-fde6-4370-88c4-22263ba9ef85 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.975975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb079475-4e57-4d3d-9605-584c9502a9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.976888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb079475-4e57-4d3d-9605-584c9502a9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.977313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb079475-4e57-4d3d-9605-584c9502a9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.977730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb079475-4e57-4d3d-9605-584c9502a9d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.978623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb079475-4e57-4d3d-9605-584c9502a9d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:07.979098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb079475-4e57-4d3d-9605-584c9502a9d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.980604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb079475-4e57-4d3d-9605-584c9502a9d2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.994479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 346/688] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:08.006925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb079475-4e57-4d3d-9605-584c9502a9d2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:08.033089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 343/689] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:08.039252 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b1eb1-7511-4837-a777-221db0e90f56 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:08.118581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:08.145543 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb079475-4e57-4d3d-9605-584c9502a9d2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:08.184137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf8872-81d7-4975-8abb-8f2da872cb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:08.184891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf8872-81d7-4975-8abb-8f2da872cb64 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:08.185178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf8872-81d7-4975-8abb-8f2da872cb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:08.186009 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf8872-81d7-4975-8abb-8f2da872cb64 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:08.186725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf8872-81d7-4975-8abb-8f2da872cb64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:08.188441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf8872-81d7-4975-8abb-8f2da872cb64 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:08.198296 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:08.212571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 347/690] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:42:08 2022] POST /identity/v3/users => generated 254 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:08.254687 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b1eb1-7511-4837-a777-221db0e90f56 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:08.302727 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4ec69-55df-40a9-88af-a893854f5dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:08.303655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4ec69-55df-40a9-88af-a893854f5dea None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:08.303942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4ec69-55df-40a9-88af-a893854f5dea None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:08.304214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4ec69-55df-40a9-88af-a893854f5dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:08.321834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4ec69-55df-40a9-88af-a893854f5dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:08.323424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4ec69-55df-40a9-88af-a893854f5dea None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-abd4ec69-55df-40a9-88af-a893854f5dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:08.346899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:08.347907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:08.348784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:08.348784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:08.348784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:08.348784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:08.348784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 344/691] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:08.355168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf8872-81d7-4975-8abb-8f2da872cb64 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:08.488438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf8872-81d7-4975-8abb-8f2da872cb64 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:08.526242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cec43-1629-4ff0-aa2d-a19d91c5703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:08.526911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cec43-1629-4ff0-aa2d-a19d91c5703e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:08.527251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cec43-1629-4ff0-aa2d-a19d91c5703e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:08.527527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cec43-1629-4ff0-aa2d-a19d91c5703e None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:08.528302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cec43-1629-4ff0-aa2d-a19d91c5703e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:08.528613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cec43-1629-4ff0-aa2d-a19d91c5703e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:08.530227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cec43-1629-4ff0-aa2d-a19d91c5703e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:08.542815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 348/692] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:08.550985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4ec69-55df-40a9-88af-a893854f5dea None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:08.662241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:08.665676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4ec69-55df-40a9-88af-a893854f5dea None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:08.710115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ee13e-5f80-44af-b3e5-1fb835c40a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:08.710986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ee13e-5f80-44af-b3e5-1fb835c40a3f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:08.711279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ee13e-5f80-44af-b3e5-1fb835c40a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:08.711580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ee13e-5f80-44af-b3e5-1fb835c40a3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:08.721583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ee13e-5f80-44af-b3e5-1fb835c40a3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:08.723087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ee13e-5f80-44af-b3e5-1fb835c40a3f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-692ee13e-5f80-44af-b3e5-1fb835c40a3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:08.744220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:08.745127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:08.746061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:08.746061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:08.746061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:08.746061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:08.746061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:08.746061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:08.746061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:08.746061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:08.746061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 345/693] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:08.751732 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cec43-1629-4ff0-aa2d-a19d91c5703e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:08.807007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:08.875549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cec43-1629-4ff0-aa2d-a19d91c5703e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:08.921474 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52df6d7-7b24-4f97-b464-f1f77ca8a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:08.922171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52df6d7-7b24-4f97-b464-f1f77ca8a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:08.922451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52df6d7-7b24-4f97-b464-f1f77ca8a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:08.922733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52df6d7-7b24-4f97-b464-f1f77ca8a0b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:08.923518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52df6d7-7b24-4f97-b464-f1f77ca8a0b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:08.923824 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52df6d7-7b24-4f97-b464-f1f77ca8a0b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:08.925238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52df6d7-7b24-4f97-b464-f1f77ca8a0b0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:08.942064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 349/694] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:08.947868 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ee13e-5f80-44af-b3e5-1fb835c40a3f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:09.073731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ee13e-5f80-44af-b3e5-1fb835c40a3f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:09.126327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760264c7-5d59-42ba-899e-8b7eacea6f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:09.127006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760264c7-5d59-42ba-899e-8b7eacea6f09 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:09.127287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760264c7-5d59-42ba-899e-8b7eacea6f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:09.127563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760264c7-5d59-42ba-899e-8b7eacea6f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:09.128403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760264c7-5d59-42ba-899e-8b7eacea6f09 None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=c0e6fc45641f4c279def2d4aa971978d) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:09.128712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760264c7-5d59-42ba-899e-8b7eacea6f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:09.130203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760264c7-5d59-42ba-899e-8b7eacea6f09 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:09.141909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 346/695] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:08 2022] GET /identity/v3/role_assignments?user.id=c0e6fc45641f4c279def2d4aa971978d&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:09.664551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1c76-4867-4cb1-a005-5ea6252cb5dd None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:09.664838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1c76-4867-4cb1-a005-5ea6252cb5dd None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:09.665115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1c76-4867-4cb1-a005-5ea6252cb5dd None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:09.666752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 350/696] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:09.672636 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b6818-0e66-4bc9-8571-648a83e15abf None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:09.672919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b6818-0e66-4bc9-8571-648a83e15abf None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:09.673196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b6818-0e66-4bc9-8571-648a83e15abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:09.695119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-0a2b6818-0e66-4bc9-8571-648a83e15abf None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:09.696323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0a2b6818-0e66-4bc9-8571-648a83e15abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:09.707989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:09.778280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 347/697] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:09.802121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b1c76-4867-4cb1-a005-5ea6252cb5dd None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:09.904617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:09.908610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b1c76-4867-4cb1-a005-5ea6252cb5dd None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:09.944753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba77a3-6a2c-454f-af53-589c5c2fc7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:09.945520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba77a3-6a2c-454f-af53-589c5c2fc7dc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:09.945806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba77a3-6a2c-454f-af53-589c5c2fc7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:09.946109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba77a3-6a2c-454f-af53-589c5c2fc7dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:09.958179 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba77a3-6a2c-454f-af53-589c5c2fc7dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d3ba77a3-6a2c-454f-af53-589c5c2fc7dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:09.966089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:09.967161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:09.968067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 351/698] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:09.973863 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b6818-0e66-4bc9-8571-648a83e15abf None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:10.084361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b6818-0e66-4bc9-8571-648a83e15abf None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:10.101432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bbcba-5a32-47de-966b-5b68bd956ff9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.101758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bbcba-5a32-47de-966b-5b68bd956ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.102015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bbcba-5a32-47de-966b-5b68bd956ff9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.106105 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 352/699] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:10.110608 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ee7d-02ee-4a3a-9efb-65a14083b8c0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.110874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ee7d-02ee-4a3a-9efb-65a14083b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.111156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ee7d-02ee-4a3a-9efb-65a14083b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.120581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76dc96-33ba-4f2e-b0eb-5dafd2a9da9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:10.121300 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76dc96-33ba-4f2e-b0eb-5dafd2a9da9a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.121584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76dc96-33ba-4f2e-b0eb-5dafd2a9da9a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.121858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76dc96-33ba-4f2e-b0eb-5dafd2a9da9a None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.122634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76dc96-33ba-4f2e-b0eb-5dafd2a9da9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:10.123502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76dc96-33ba-4f2e-b0eb-5dafd2a9da9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:10.124867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76dc96-33ba-4f2e-b0eb-5dafd2a9da9a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:10.134310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 348/700] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:10.141521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76dc96-33ba-4f2e-b0eb-5dafd2a9da9a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:10.166259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:10.171780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a173ee7d-02ee-4a3a-9efb-65a14083b8c0 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:10.173682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a173ee7d-02ee-4a3a-9efb-65a14083b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:10.249647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76dc96-33ba-4f2e-b0eb-5dafd2a9da9a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:10.287651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651f6ae-3bf0-4626-b71d-b4f314b3400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:10.288533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651f6ae-3bf0-4626-b71d-b4f314b3400c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.288811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651f6ae-3bf0-4626-b71d-b4f314b3400c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.289081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651f6ae-3bf0-4626-b71d-b4f314b3400c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.300923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651f6ae-3bf0-4626-b71d-b4f314b3400c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:10.302465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651f6ae-3bf0-4626-b71d-b4f314b3400c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-3651f6ae-3bf0-4626-b71d-b4f314b3400c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:10.320893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:10.321836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:10.322765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:10.322765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:10.322765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:10.322765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:10.322765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 349/701] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:10.328402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651f6ae-3bf0-4626-b71d-b4f314b3400c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:10.398388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:10.442273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 353/702] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:10.444121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20522e9-bc4f-406f-b394-f20cf9b8b343 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.444626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20522e9-bc4f-406f-b394-f20cf9b8b343 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.445131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20522e9-bc4f-406f-b394-f20cf9b8b343 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.445478 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651f6ae-3bf0-4626-b71d-b4f314b3400c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:10.451497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 354/703] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:10.452889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e456c1-4338-4938-9c61-5d0c66766cfd None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.453405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e456c1-4338-4938-9c61-5d0c66766cfd None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.453908 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e456c1-4338-4938-9c61-5d0c66766cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.470865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-51e456c1-4338-4938-9c61-5d0c66766cfd None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:10.472416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-51e456c1-4338-4938-9c61-5d0c66766cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:10.489668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fdb9c-0841-4f85-a52e-41bbeca63cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:10.490704 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fdb9c-0841-4f85-a52e-41bbeca63cff None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.491192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fdb9c-0841-4f85-a52e-41bbeca63cff None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.491695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fdb9c-0841-4f85-a52e-41bbeca63cff None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.492619 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fdb9c-0841-4f85-a52e-41bbeca63cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:10.493129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fdb9c-0841-4f85-a52e-41bbeca63cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:10.494740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fdb9c-0841-4f85-a52e-41bbeca63cff None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:10.509358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 350/704] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:10.510518 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fdb9c-0841-4f85-a52e-41bbeca63cff None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:10.569909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 355/705] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:10.569909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e456c1-4338-4938-9c61-5d0c66766cfd None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:10.608812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:10.664052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fdb9c-0841-4f85-a52e-41bbeca63cff None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:10.692732 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:10.710146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e456c1-4338-4938-9c61-5d0c66766cfd None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:10.717797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925e336-22d9-404a-84ef-a45f514b3920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:10.718664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925e336-22d9-404a-84ef-a45f514b3920 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.718948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925e336-22d9-404a-84ef-a45f514b3920 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.719232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925e336-22d9-404a-84ef-a45f514b3920 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.719895 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925e336-22d9-404a-84ef-a45f514b3920 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:10.721930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925e336-22d9-404a-84ef-a45f514b3920 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-7925e336-22d9-404a-84ef-a45f514b3920 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:10.742829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:10.743891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:10.744735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 351/706] 10.222.0.81 () {56 vars in 1129 bytes} [Thu Jun 16 14:42:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:10.745572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925e336-22d9-404a-84ef-a45f514b3920 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:10.760065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1466ff-2be0-4956-a334-9b73ce52e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:10.760841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1466ff-2be0-4956-a334-9b73ce52e730 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.761129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1466ff-2be0-4956-a334-9b73ce52e730 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.761406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1466ff-2be0-4956-a334-9b73ce52e730 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.770637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1466ff-2be0-4956-a334-9b73ce52e730 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:10.772107 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1466ff-2be0-4956-a334-9b73ce52e730 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3b1466ff-2be0-4956-a334-9b73ce52e730 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:10.788700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:10.789686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:10.790657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:10.790657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:10.790657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:10.790657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:10.790657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:10.790657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:10.790657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:10.790657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:10.790657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:10.790657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:10.795207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 356/707] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Jun 16 14:42:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:10.796127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1466ff-2be0-4956-a334-9b73ce52e730 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:10.886399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925e336-22d9-404a-84ef-a45f514b3920 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:10.897375 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:10.925773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1466ff-2be0-4956-a334-9b73ce52e730 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:10.928164 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a7964-0fc2-41c2-b47c-937e53afc3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:10.928973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7964-0fc2-41c2-b47c-937e53afc3be None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.929262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7964-0fc2-41c2-b47c-937e53afc3be None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.930289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7964-0fc2-41c2-b47c-937e53afc3be None admin] PATH_INFO: `/v3/services/network` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.930289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a7964-0fc2-41c2-b47c-937e53afc3be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:10.931597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a7964-0fc2-41c2-b47c-937e53afc3be None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-1d1a7964-0fc2-41c2-b47c-937e53afc3be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:10.944329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:10.945403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:42:10.946287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:10.950304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 352/708] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:10 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:10.951873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a7964-0fc2-41c2-b47c-937e53afc3be None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:10.975914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707f30-6fc9-4162-8f1d-41e7d55af1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:10.977471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707f30-6fc9-4162-8f1d-41e7d55af1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.978015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707f30-6fc9-4162-8f1d-41e7d55af1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.978655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707f30-6fc9-4162-8f1d-41e7d55af1c1 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.979646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707f30-6fc9-4162-8f1d-41e7d55af1c1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:10.980404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707f30-6fc9-4162-8f1d-41e7d55af1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:10.982860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707f30-6fc9-4162-8f1d-41e7d55af1c1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:10.993920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 357/709] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Jun 16 14:42:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:10.993920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707f30-6fc9-4162-8f1d-41e7d55af1c1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:11.015405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:11.079900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a7964-0fc2-41c2-b47c-937e53afc3be None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:11.118311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27e06c-615f-4b66-a108-78452cc80208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:11.118994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27e06c-615f-4b66-a108-78452cc80208 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:11.119286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27e06c-615f-4b66-a108-78452cc80208 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:11.119630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27e06c-615f-4b66-a108-78452cc80208 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:11.120400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27e06c-615f-4b66-a108-78452cc80208 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:11.120706 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27e06c-615f-4b66-a108-78452cc80208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:11.122182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27e06c-615f-4b66-a108-78452cc80208 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:11.132058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707f30-6fc9-4162-8f1d-41e7d55af1c1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:11.145975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 353/710] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Jun 16 14:42:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:11.146994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27e06c-615f-4b66-a108-78452cc80208 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:11.173658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a22a4-10e9-49e2-a231-7b9f3af1eee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:11.174617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a22a4-10e9-49e2-a231-7b9f3af1eee7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:11.175052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a22a4-10e9-49e2-a231-7b9f3af1eee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:11.175493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a22a4-10e9-49e2-a231-7b9f3af1eee7 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:11.176337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a22a4-10e9-49e2-a231-7b9f3af1eee7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:11.176789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a22a4-10e9-49e2-a231-7b9f3af1eee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:11.178313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a22a4-10e9-49e2-a231-7b9f3af1eee7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:11.183136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 358/711] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:11.184576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cd365-bf99-40b2-830e-49c8573ac903 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:11.184861 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cd365-bf99-40b2-830e-49c8573ac903 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:11.185217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cd365-bf99-40b2-830e-49c8573ac903 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:11.190937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 359/712] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:11.190937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cd365-bf99-40b2-830e-49c8573ac903 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:11.202045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:11.263796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27e06c-615f-4b66-a108-78452cc80208 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:11.267483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:11.306076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126c6d8-a809-45f3-97b8-c63231e8efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:11.306753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c6d8-a809-45f3-97b8-c63231e8efa7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:11.307039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c6d8-a809-45f3-97b8-c63231e8efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:11.307318 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c6d8-a809-45f3-97b8-c63231e8efa7 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:11.308024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126c6d8-a809-45f3-97b8-c63231e8efa7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:11.308333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126c6d8-a809-45f3-97b8-c63231e8efa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:11.309423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cd365-bf99-40b2-830e-49c8573ac903 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:11.309714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126c6d8-a809-45f3-97b8-c63231e8efa7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:11.316093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 354/713] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Jun 16 14:42:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:11.316901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126c6d8-a809-45f3-97b8-c63231e8efa7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:11.362598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b007e4-6c79-400a-8596-cd5674c44226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:11.363274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b007e4-6c79-400a-8596-cd5674c44226 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:11.363555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b007e4-6c79-400a-8596-cd5674c44226 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:11.363830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b007e4-6c79-400a-8596-cd5674c44226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:11.455664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126c6d8-a809-45f3-97b8-c63231e8efa7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:11.474424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b007e4-6c79-400a-8596-cd5674c44226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:11.476976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b007e4-6c79-400a-8596-cd5674c44226 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:11.492574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:11.500262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9138d-dddf-4e93-acde-3586859ff263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:11.500952 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9138d-dddf-4e93-acde-3586859ff263 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:11.501241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9138d-dddf-4e93-acde-3586859ff263 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:11.501516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9138d-dddf-4e93-acde-3586859ff263 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:11.502413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9138d-dddf-4e93-acde-3586859ff263 None admin] RBAC: Adding query filter params (type=network) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:11.502601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9138d-dddf-4e93-acde-3586859ff263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:11.504001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9138d-dddf-4e93-acde-3586859ff263 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:11.509600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 355/714] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:11.510735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d9fa4-f021-4238-b93b-93409414ab0b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:11.511118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d9fa4-f021-4238-b93b-93409414ab0b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:11.511297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d9fa4-f021-4238-b93b-93409414ab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:11.532938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-651d9fa4-f021-4238-b93b-93409414ab0b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:11.534975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-651d9fa4-f021-4238-b93b-93409414ab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:11.577764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:11.663747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 360/715] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:11.665777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 356/716] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:11.671578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b007e4-6c79-400a-8596-cd5674c44226 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:11.718948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d9fa4-f021-4238-b93b-93409414ab0b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:11.792474 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b007e4-6c79-400a-8596-cd5674c44226 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:11.803055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:11.831075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5382e-7cb3-4298-bf75-187bce1123d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:11.831888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5382e-7cb3-4298-bf75-187bce1123d2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:11.832400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5382e-7cb3-4298-bf75-187bce1123d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:11.832510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5382e-7cb3-4298-bf75-187bce1123d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:11.842495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d9fa4-f021-4238-b93b-93409414ab0b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:11.843599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5382e-7cb3-4298-bf75-187bce1123d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:11.845127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5382e-7cb3-4298-bf75-187bce1123d2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-9cc5382e-7cb3-4298-bf75-187bce1123d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:11.865024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:11.866006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:11.866913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:11.866913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:11.866913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:11.866913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:11.866913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 361/717] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:11.872031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5382e-7cb3-4298-bf75-187bce1123d2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:11.885026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ec34b-fdb7-4ee3-8e18-9fb8e0bf20a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:11.886185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec34b-fdb7-4ee3-8e18-9fb8e0bf20a7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:11.886670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec34b-fdb7-4ee3-8e18-9fb8e0bf20a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:11.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec34b-fdb7-4ee3-8e18-9fb8e0bf20a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:11.899789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ec34b-fdb7-4ee3-8e18-9fb8e0bf20a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-c69ec34b-fdb7-4ee3-8e18-9fb8e0bf20a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:11.909460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:11.910475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:11.911296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:11.914065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 357/718] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:11.926952 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ec34b-fdb7-4ee3-8e18-9fb8e0bf20a7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:11.978443 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:11.993214 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5382e-7cb3-4298-bf75-187bce1123d2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:12.071493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e137fa8-6f9d-48fa-acb2-a93a9896c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:12.072129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e137fa8-6f9d-48fa-acb2-a93a9896c89c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:12.072413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e137fa8-6f9d-48fa-acb2-a93a9896c89c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:12.072686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e137fa8-6f9d-48fa-acb2-a93a9896c89c None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:12.073405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e137fa8-6f9d-48fa-acb2-a93a9896c89c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:12.073711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e137fa8-6f9d-48fa-acb2-a93a9896c89c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:12.075101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e137fa8-6f9d-48fa-acb2-a93a9896c89c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:12.103049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 362/719] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:12.104462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a88cb-9ba4-4ade-9c1f-f609b522c016 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:12.104791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a88cb-9ba4-4ade-9c1f-f609b522c016 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:12.105072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a88cb-9ba4-4ade-9c1f-f609b522c016 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:12.108064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 363/720] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:12.108928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a88cb-9ba4-4ade-9c1f-f609b522c016 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:12.132459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ec34b-fdb7-4ee3-8e18-9fb8e0bf20a7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:12.136770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:12.182040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5204b-2a5d-4a5e-9add-08e9c906ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:12.182957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5204b-2a5d-4a5e-9add-08e9c906ef72 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:12.183637 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5204b-2a5d-4a5e-9add-08e9c906ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:12.184039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5204b-2a5d-4a5e-9add-08e9c906ef72 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:12.185039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5204b-2a5d-4a5e-9add-08e9c906ef72 None admin] RBAC: Adding query filter params (name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:12.185896 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5204b-2a5d-4a5e-9add-08e9c906ef72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:12.187274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5204b-2a5d-4a5e-9add-08e9c906ef72 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:12.201987 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 358/721] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:42:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:12.203516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd6ba0-29a2-4442-a08e-1bda85bcc80d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:12.203811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd6ba0-29a2-4442-a08e-1bda85bcc80d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:12.204360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd6ba0-29a2-4442-a08e-1bda85bcc80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:12.226458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-32bd6ba0-29a2-4442-a08e-1bda85bcc80d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:12.227659 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-32bd6ba0-29a2-4442-a08e-1bda85bcc80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:12.240994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a88cb-9ba4-4ade-9c1f-f609b522c016 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:12.291522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36486fbc-82c6-4f90-8115-cca2f0fcd555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:12.293576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486fbc-82c6-4f90-8115-cca2f0fcd555 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:12.294284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486fbc-82c6-4f90-8115-cca2f0fcd555 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:12.295134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486fbc-82c6-4f90-8115-cca2f0fcd555 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:12.305550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36486fbc-82c6-4f90-8115-cca2f0fcd555 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:12.307905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36486fbc-82c6-4f90-8115-cca2f0fcd555 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:12.315330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 359/722] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:12.322856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd6ba0-29a2-4442-a08e-1bda85bcc80d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-36486fbc-82c6-4f90-8115-cca2f0fcd555 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:12.325326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:12.327057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:12.328117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:12.328117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:12.328117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:12.328117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:12.328117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:12.328117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:12.328117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:12.328117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:12.331353 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 364/723] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:12.338981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36486fbc-82c6-4f90-8115-cca2f0fcd555 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:12.351720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:12.452302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd6ba0-29a2-4442-a08e-1bda85bcc80d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:12.453185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:12.479649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36486fbc-82c6-4f90-8115-cca2f0fcd555 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:12.496046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b9e97-8b31-4667-a1e2-c404e1ff607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:12.497454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b9e97-8b31-4667-a1e2-c404e1ff607c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:12.498985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b9e97-8b31-4667-a1e2-c404e1ff607c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:12.499866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b9e97-8b31-4667-a1e2-c404e1ff607c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:12.515219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b9e97-8b31-4667-a1e2-c404e1ff607c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:12.517352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b9e97-8b31-4667-a1e2-c404e1ff607c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:12.517485 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e218f8-4584-493a-802e-f33fa668df81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:12.518188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e218f8-4584-493a-802e-f33fa668df81 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:12.518519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e218f8-4584-493a-802e-f33fa668df81 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:12.518791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e218f8-4584-493a-802e-f33fa668df81 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:12.519624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e218f8-4584-493a-802e-f33fa668df81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:12.519933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e218f8-4584-493a-802e-f33fa668df81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:12.521399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e218f8-4584-493a-802e-f33fa668df81 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:12.538769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 365/724] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:12.538769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e218f8-4584-493a-802e-f33fa668df81 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-434b9e97-8b31-4667-a1e2-c404e1ff607c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:12.543690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:12.545128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:12.546151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:12.546151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:12.546151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:12.546151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:12.550405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 360/725] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:12.551318 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b9e97-8b31-4667-a1e2-c404e1ff607c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:12.638031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:12.677780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e218f8-4584-493a-802e-f33fa668df81 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:12.684154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b9e97-8b31-4667-a1e2-c404e1ff607c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:12.715501 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da125a46-ed77-42d3-861e-daed048e9eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:12.717260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125a46-ed77-42d3-861e-daed048e9eda None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:12.717815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125a46-ed77-42d3-861e-daed048e9eda None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:12.718310 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125a46-ed77-42d3-861e-daed048e9eda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:12.726008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a2453-a24f-4060-9856-e95a095c1963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:12.726668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2453-a24f-4060-9856-e95a095c1963 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:12.726947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2453-a24f-4060-9856-e95a095c1963 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:12.727215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2453-a24f-4060-9856-e95a095c1963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:12.728004 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:12.728111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a2453-a24f-4060-9856-e95a095c1963 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=f2faa046b0294a0ba1090be84bb1cebc) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:12.728326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a2453-a24f-4060-9856-e95a095c1963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:12.730363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a2453-a24f-4060-9856-e95a095c1963 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:12.733859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da125a46-ed77-42d3-861e-daed048e9eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:12.745915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 361/726] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:12 2022] GET /identity/v3/role_assignments?user.id=f2faa046b0294a0ba1090be84bb1cebc&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:12.745915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a2453-a24f-4060-9856-e95a095c1963 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-da125a46-ed77-42d3-861e-daed048e9eda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:12.756804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:12.757865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:12.758729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 366/727] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:12.773215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da125a46-ed77-42d3-861e-daed048e9eda None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:12.874520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a2453-a24f-4060-9856-e95a095c1963 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:12.909620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:12.931253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342e239-ab5e-4328-b754-607b60a68499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:12.931943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342e239-ab5e-4328-b754-607b60a68499 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:12.932227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342e239-ab5e-4328-b754-607b60a68499 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:12.932502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342e239-ab5e-4328-b754-607b60a68499 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:12.933228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342e239-ab5e-4328-b754-607b60a68499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:12.933531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342e239-ab5e-4328-b754-607b60a68499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:12.934956 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342e239-ab5e-4328-b754-607b60a68499 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:12.950615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 362/728] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:12.961789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342e239-ab5e-4328-b754-607b60a68499 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:12.995936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da125a46-ed77-42d3-861e-daed048e9eda None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:13.053310 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c27e-bc65-4a1a-a64a-9b3c23a697b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:13.054390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c27e-bc65-4a1a-a64a-9b3c23a697b9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.054866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c27e-bc65-4a1a-a64a-9b3c23a697b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.055516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c27e-bc65-4a1a-a64a-9b3c23a697b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.057418 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c27e-bc65-4a1a-a64a-9b3c23a697b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:13.060254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c27e-bc65-4a1a-a64a-9b3c23a697b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:13.067100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c27e-bc65-4a1a-a64a-9b3c23a697b9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:13.085192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 367/729] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:13.087700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c27e-bc65-4a1a-a64a-9b3c23a697b9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:13.131330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342e239-ab5e-4328-b754-607b60a68499 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:13.169035 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c4491-9363-48cf-a6c0-11ff5f25a352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:13.172050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c4491-9363-48cf-a6c0-11ff5f25a352 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.172538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c4491-9363-48cf-a6c0-11ff5f25a352 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.173025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c4491-9363-48cf-a6c0-11ff5f25a352 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.181529 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c4491-9363-48cf-a6c0-11ff5f25a352 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:13.183263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c4491-9363-48cf-a6c0-11ff5f25a352 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-a20c4491-9363-48cf-a6c0-11ff5f25a352 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:13.201616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:13.202753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:13.203679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:13.203679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:13.203679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:13.203679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:13.203679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:13.203679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:13.203679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:13.203679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:13.203679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:13.203679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:13.210660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 363/730] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Jun 16 14:42:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:13.212719 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c4491-9363-48cf-a6c0-11ff5f25a352 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:13.271939 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:13.273320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:13.332612 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c4491-9363-48cf-a6c0-11ff5f25a352 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:13.374521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f51dc-b54b-4d9e-9efb-c05c917bdc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:13.376091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f51dc-b54b-4d9e-9efb-c05c917bdc84 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.376696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f51dc-b54b-4d9e-9efb-c05c917bdc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.377173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f51dc-b54b-4d9e-9efb-c05c917bdc84 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.378890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f51dc-b54b-4d9e-9efb-c05c917bdc84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:13.379407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f51dc-b54b-4d9e-9efb-c05c917bdc84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:13.381046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f51dc-b54b-4d9e-9efb-c05c917bdc84 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:13.406108 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c27e-bc65-4a1a-a64a-9b3c23a697b9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:13.406719 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 364/731] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Jun 16 14:42:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:13.410880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f51dc-b54b-4d9e-9efb-c05c917bdc84 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:13.502570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ddba1-b616-4312-9c03-18b28cfb4fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:13.503294 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ddba1-b616-4312-9c03-18b28cfb4fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.503576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ddba1-b616-4312-9c03-18b28cfb4fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.503857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ddba1-b616-4312-9c03-18b28cfb4fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.529622 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ddba1-b616-4312-9c03-18b28cfb4fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:13.531165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ddba1-b616-4312-9c03-18b28cfb4fc7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f78ddba1-b616-4312-9c03-18b28cfb4fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:13.557759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:13.558727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:13.560594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:13.560594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:13.560594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:13.560594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:13.560594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 368/732] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 472 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:13.566149 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ddba1-b616-4312-9c03-18b28cfb4fc7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:13.585791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f51dc-b54b-4d9e-9efb-c05c917bdc84 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:13.604187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:13.687802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ddba1-b616-4312-9c03-18b28cfb4fc7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:13.711374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:13.718993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6ebeb-acb6-44c6-8e65-0a6cb5101961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:13.719894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6ebeb-acb6-44c6-8e65-0a6cb5101961 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.720553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6ebeb-acb6-44c6-8e65-0a6cb5101961 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.720861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6ebeb-acb6-44c6-8e65-0a6cb5101961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.730180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35dcf1-3bba-41f3-a244-c9aac675026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:13.731155 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35dcf1-3bba-41f3-a244-c9aac675026c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.731728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35dcf1-3bba-41f3-a244-c9aac675026c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.733491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35dcf1-3bba-41f3-a244-c9aac675026c None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.734663 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35dcf1-3bba-41f3-a244-c9aac675026c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:13.735172 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35dcf1-3bba-41f3-a244-c9aac675026c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:13.736993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35dcf1-3bba-41f3-a244-c9aac675026c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:13.752344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 369/733] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:13.758883 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35dcf1-3bba-41f3-a244-c9aac675026c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:13.857154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6ebeb-acb6-44c6-8e65-0a6cb5101961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:13.859055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6ebeb-acb6-44c6-8e65-0a6cb5101961 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:13.907347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35dcf1-3bba-41f3-a244-c9aac675026c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:13.943476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faa301-e0b5-47e4-8e7a-aa28087b03b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:13.944348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faa301-e0b5-47e4-8e7a-aa28087b03b3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.944703 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faa301-e0b5-47e4-8e7a-aa28087b03b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.945031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faa301-e0b5-47e4-8e7a-aa28087b03b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.952557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85faa301-e0b5-47e4-8e7a-aa28087b03b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:13.954138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85faa301-e0b5-47e4-8e7a-aa28087b03b3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-85faa301-e0b5-47e4-8e7a-aa28087b03b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:13.968936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:13.969946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:13.970879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:13.970879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:13.970879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:13.970879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:13.970879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:13.970879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:13.970879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:13.970879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:13.970879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:42:13.970879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:13.975183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 370/734] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:13.976631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8964b-da94-489a-bee1-078dc392519a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.976912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8964b-da94-489a-bee1-078dc392519a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.977184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8964b-da94-489a-bee1-078dc392519a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.979046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 371/735] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:13.979919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8964b-da94-489a-bee1-078dc392519a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:13.992455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 365/736] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:13.994144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc840b-eadc-4cdf-a8f0-ec5a64c6e4a3 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.994807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc840b-eadc-4cdf-a8f0-ec5a64c6e4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.995290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc840b-eadc-4cdf-a8f0-ec5a64c6e4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.016204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c7fc840b-eadc-4cdf-a8f0-ec5a64c6e4a3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:14.017785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c7fc840b-eadc-4cdf-a8f0-ec5a64c6e4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:14.020350 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.026270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.100797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8964b-da94-489a-bee1-078dc392519a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.103629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 366/737] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:14.104676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc840b-eadc-4cdf-a8f0-ec5a64c6e4a3 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.137191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98364778-1622-4516-ae51-7a047c7fe81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.138100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364778-1622-4516-ae51-7a047c7fe81c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.138447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364778-1622-4516-ae51-7a047c7fe81c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.139388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364778-1622-4516-ae51-7a047c7fe81c None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.140255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98364778-1622-4516-ae51-7a047c7fe81c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:14.140565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98364778-1622-4516-ae51-7a047c7fe81c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:14.142311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98364778-1622-4516-ae51-7a047c7fe81c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:14.162359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 372/738] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Jun 16 14:42:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:14.163824 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961e79-7bbf-4aeb-a1d4-6451db89f9a7 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.164111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961e79-7bbf-4aeb-a1d4-6451db89f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.164384 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961e79-7bbf-4aeb-a1d4-6451db89f9a7 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.165603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 373/739] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:14.166361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8961e79-7bbf-4aeb-a1d4-6451db89f9a7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.221403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc840b-eadc-4cdf-a8f0-ec5a64c6e4a3 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.262154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d758a-d9b5-47ec-b648-d6f6622befba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.264805 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d758a-d9b5-47ec-b648-d6f6622befba None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.265337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d758a-d9b5-47ec-b648-d6f6622befba None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.266154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d758a-d9b5-47ec-b648-d6f6622befba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.267982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.276256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.279568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8961e79-7bbf-4aeb-a1d4-6451db89f9a7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.281359 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d758a-d9b5-47ec-b648-d6f6622befba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:14.283992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d758a-d9b5-47ec-b648-d6f6622befba None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-1d1d758a-d9b5-47ec-b648-d6f6622befba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:14.307028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:14.307992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:14.308890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:14.308890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:14.308890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:14.308890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:14.309120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 367/740] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:14.310950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea42e3-3c97-4df0-aa4b-7dd88da22163 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.311257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea42e3-3c97-4df0-aa4b-7dd88da22163 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.311496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea42e3-3c97-4df0-aa4b-7dd88da22163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.320420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556277e-0d39-4c5e-abc3-35f899aea327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.321090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556277e-0d39-4c5e-abc3-35f899aea327 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.321365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556277e-0d39-4c5e-abc3-35f899aea327 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.321630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556277e-0d39-4c5e-abc3-35f899aea327 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.322379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556277e-0d39-4c5e-abc3-35f899aea327 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:14.323733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556277e-0d39-4c5e-abc3-35f899aea327 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:14.331331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ecea42e3-3c97-4df0-aa4b-7dd88da22163 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:14.332746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ecea42e3-3c97-4df0-aa4b-7dd88da22163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:14.340036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 374/741] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:14 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:14.341006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556277e-0d39-4c5e-abc3-35f899aea327 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.436543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 368/742] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:14.437457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea42e3-3c97-4df0-aa4b-7dd88da22163 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.484719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556277e-0d39-4c5e-abc3-35f899aea327 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.527999 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8e08b-97cd-4280-a2c0-ec943529e5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.529917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e08b-97cd-4280-a2c0-ec943529e5eb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.530532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e08b-97cd-4280-a2c0-ec943529e5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.531116 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e08b-97cd-4280-a2c0-ec943529e5eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.564949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.576219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea42e3-3c97-4df0-aa4b-7dd88da22163 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.598084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.617287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e326ba1-fad8-4546-b9ee-36c29be2a9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.618012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e326ba1-fad8-4546-b9ee-36c29be2a9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.618963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e326ba1-fad8-4546-b9ee-36c29be2a9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.618963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e326ba1-fad8-4546-b9ee-36c29be2a9b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.619263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e326ba1-fad8-4546-b9ee-36c29be2a9b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:14.619606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e326ba1-fad8-4546-b9ee-36c29be2a9b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:14.620994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e326ba1-fad8-4546-b9ee-36c29be2a9b3 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:14.626434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8e08b-97cd-4280-a2c0-ec943529e5eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:14.627993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8e08b-97cd-4280-a2c0-ec943529e5eb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:14.636927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 369/743] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:14.639402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e326ba1-fad8-4546-b9ee-36c29be2a9b3 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.768705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e326ba1-fad8-4546-b9ee-36c29be2a9b3 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.777931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 375/744] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:14.779276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8e08b-97cd-4280-a2c0-ec943529e5eb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.806948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6e9b-ac67-47d3-b561-c325f13646eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.807626 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6e9b-ac67-47d3-b561-c325f13646eb None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.807913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6e9b-ac67-47d3-b561-c325f13646eb None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.808197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6e9b-ac67-47d3-b561-c325f13646eb None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.808926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6e9b-ac67-47d3-b561-c325f13646eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:14.811053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6e9b-ac67-47d3-b561-c325f13646eb None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:14.837914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 370/745] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:14 2022] POST /identity/v3/services => generated 240 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:14.837914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6e9b-ac67-47d3-b561-c325f13646eb None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.863563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.879151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.949309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8e08b-97cd-4280-a2c0-ec943529e5eb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.974777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6e9b-ac67-47d3-b561-c325f13646eb None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.019950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353b9d4-89df-4ca5-9bcf-693e36622df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.020235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5b0ea-3e63-4259-b950-465eedd7da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.021177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5b0ea-3e63-4259-b950-465eedd7da7d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.021331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353b9d4-89df-4ca5-9bcf-693e36622df6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.021647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5b0ea-3e63-4259-b950-465eedd7da7d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.021946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353b9d4-89df-4ca5-9bcf-693e36622df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.022171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5b0ea-3e63-4259-b950-465eedd7da7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.022550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353b9d4-89df-4ca5-9bcf-693e36622df6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.038317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5b0ea-3e63-4259-b950-465eedd7da7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.038317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5b0ea-3e63-4259-b950-465eedd7da7d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.040773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353b9d4-89df-4ca5-9bcf-693e36622df6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.042813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353b9d4-89df-4ca5-9bcf-693e36622df6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-87a5b0ea-3e63-4259-b950-465eedd7da7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:15.058776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:15.059941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:15.061482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:15.061482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:15.061482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:15.061482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:15.062846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 371/746] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:15.068455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5b0ea-3e63-4259-b950-465eedd7da7d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-6353b9d4-89df-4ca5-9bcf-693e36622df6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:15.070767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:15.071821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:15.072803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:15.072803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:15.072803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:15.072803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:15.072803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:15.072803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:15.072803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:15.072803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:15.075143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 376/747] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:15.087182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353b9d4-89df-4ca5-9bcf-693e36622df6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.194269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.200073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5b0ea-3e63-4259-b950-465eedd7da7d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.238605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353b9d4-89df-4ca5-9bcf-693e36622df6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.249055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c06dfa-1ca3-4950-90ba-c3e83f51c198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.249754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c06dfa-1ca3-4950-90ba-c3e83f51c198 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.250121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c06dfa-1ca3-4950-90ba-c3e83f51c198 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.250790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c06dfa-1ca3-4950-90ba-c3e83f51c198 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.251552 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c06dfa-1ca3-4950-90ba-c3e83f51c198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:15.251873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c06dfa-1ca3-4950-90ba-c3e83f51c198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.253965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c06dfa-1ca3-4950-90ba-c3e83f51c198 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.254843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.271627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 372/748] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:15.276967 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c06dfa-1ca3-4950-90ba-c3e83f51c198 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.282899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68bb7c-e2e0-4c9c-920f-0ce706a5eb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.283585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68bb7c-e2e0-4c9c-920f-0ce706a5eb33 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.283868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68bb7c-e2e0-4c9c-920f-0ce706a5eb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.284171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68bb7c-e2e0-4c9c-920f-0ce706a5eb33 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.284991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68bb7c-e2e0-4c9c-920f-0ce706a5eb33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:15.285315 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68bb7c-e2e0-4c9c-920f-0ce706a5eb33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.286789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68bb7c-e2e0-4c9c-920f-0ce706a5eb33 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.302748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 377/749] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:15.303878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad2cb5-4e7f-485e-b9e8-dbcb9c057c67 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.304492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad2cb5-4e7f-485e-b9e8-dbcb9c057c67 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.304492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad2cb5-4e7f-485e-b9e8-dbcb9c057c67 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.305866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 378/750] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:15.310523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad2cb5-4e7f-485e-b9e8-dbcb9c057c67 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.394986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c06dfa-1ca3-4950-90ba-c3e83f51c198 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.432823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b4d63-78c6-4478-a4f9-2d7dacd62d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.433631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b4d63-78c6-4478-a4f9-2d7dacd62d14 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.433947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b4d63-78c6-4478-a4f9-2d7dacd62d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.434228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b4d63-78c6-4478-a4f9-2d7dacd62d14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.437904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad2cb5-4e7f-485e-b9e8-dbcb9c057c67 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.442173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b4d63-78c6-4478-a4f9-2d7dacd62d14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.443645 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b4d63-78c6-4478-a4f9-2d7dacd62d14 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-df9b4d63-78c6-4478-a4f9-2d7dacd62d14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:15.459277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:15.460205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:15.461092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:15.461092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:15.461092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:15.461092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:15.461092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:15.461092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:15.461092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:15.461092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:15.461092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 373/751] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:15.462082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef3344-217a-4920-9865-3bca62e7affd None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.462361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef3344-217a-4920-9865-3bca62e7affd None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.462744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef3344-217a-4920-9865-3bca62e7affd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.469724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.481360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d3ef3344-217a-4920-9865-3bca62e7affd None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:15.483133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d3ef3344-217a-4920-9865-3bca62e7affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:15.495046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8f11-4df0-4c8d-824a-6f92bbe9e035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.495712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8f11-4df0-4c8d-824a-6f92bbe9e035 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.495994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8f11-4df0-4c8d-824a-6f92bbe9e035 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.496271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8f11-4df0-4c8d-824a-6f92bbe9e035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.497100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf8f11-4df0-4c8d-824a-6f92bbe9e035 None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=7255df373d794cf8b2548b3c0876dd22) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:15.497413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf8f11-4df0-4c8d-824a-6f92bbe9e035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.498964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf8f11-4df0-4c8d-824a-6f92bbe9e035 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.506771 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 379/752] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/role_assignments?user.id=7255df373d794cf8b2548b3c0876dd22&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:15.507615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8f11-4df0-4c8d-824a-6f92bbe9e035 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.555526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.586311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 374/753] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:15.624587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef3344-217a-4920-9865-3bca62e7affd None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.676292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8f11-4df0-4c8d-824a-6f92bbe9e035 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.742351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec21552-db8d-419f-ad0c-3d65102385b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.743040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21552-db8d-419f-ad0c-3d65102385b0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.743326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21552-db8d-419f-ad0c-3d65102385b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.743603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21552-db8d-419f-ad0c-3d65102385b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.744398 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec21552-db8d-419f-ad0c-3d65102385b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:15.744711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec21552-db8d-419f-ad0c-3d65102385b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.746181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec21552-db8d-419f-ad0c-3d65102385b0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.780646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 380/754] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:15.785981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec21552-db8d-419f-ad0c-3d65102385b0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.786651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef3344-217a-4920-9865-3bca62e7affd None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.844812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10722545-bcf0-4f8c-aa26-6fb1d1205c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.845994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10722545-bcf0-4f8c-aa26-6fb1d1205c14 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.846458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10722545-bcf0-4f8c-aa26-6fb1d1205c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.846933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10722545-bcf0-4f8c-aa26-6fb1d1205c14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.849365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.871823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10722545-bcf0-4f8c-aa26-6fb1d1205c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-10722545-bcf0-4f8c-aa26-6fb1d1205c14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:15.887184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:15.888702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:15.889537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:15.891861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 375/755] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:15.898096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10722545-bcf0-4f8c-aa26-6fb1d1205c14 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.917553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.921302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec21552-db8d-419f-ad0c-3d65102385b0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.957364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e7be3-fa0e-4e91-9d78-7f403e7dbc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.958069 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e7be3-fa0e-4e91-9d78-7f403e7dbc42 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.958361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e7be3-fa0e-4e91-9d78-7f403e7dbc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.961909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e7be3-fa0e-4e91-9d78-7f403e7dbc42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.961909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e7be3-fa0e-4e91-9d78-7f403e7dbc42 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=c0e6fc45641f4c279def2d4aa971978d) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:15.961909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e7be3-fa0e-4e91-9d78-7f403e7dbc42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.961909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e7be3-fa0e-4e91-9d78-7f403e7dbc42 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.968044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 381/756] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/role_assignments?user.id=c0e6fc45641f4c279def2d4aa971978d&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:16.092094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10722545-bcf0-4f8c-aa26-6fb1d1205c14 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:16.145703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306f1e4-ef83-48aa-92d5-2a6fb43c830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.146523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306f1e4-ef83-48aa-92d5-2a6fb43c830e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.146812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306f1e4-ef83-48aa-92d5-2a6fb43c830e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.147091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306f1e4-ef83-48aa-92d5-2a6fb43c830e None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.147844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306f1e4-ef83-48aa-92d5-2a6fb43c830e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:16.148153 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306f1e4-ef83-48aa-92d5-2a6fb43c830e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.149543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306f1e4-ef83-48aa-92d5-2a6fb43c830e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.159304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 376/757] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:16.164572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e7be3-fa0e-4e91-9d78-7f403e7dbc42 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:16.275074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e7be3-fa0e-4e91-9d78-7f403e7dbc42 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:16.310897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfe36e-0c94-4082-8f94-b4511a69f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.312003 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfe36e-0c94-4082-8f94-b4511a69f9dd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.312468 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfe36e-0c94-4082-8f94-b4511a69f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.312959 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfe36e-0c94-4082-8f94-b4511a69f9dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.324350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfe36e-0c94-4082-8f94-b4511a69f9dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.326597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfe36e-0c94-4082-8f94-b4511a69f9dd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-0fbfe36e-0c94-4082-8f94-b4511a69f9dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:16.344700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:16.345650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:16.346571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:16.346571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:16.346571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:16.346571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:16.348601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 382/758] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:16.355212 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306f1e4-ef83-48aa-92d5-2a6fb43c830e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:16.433980 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:16.491623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306f1e4-ef83-48aa-92d5-2a6fb43c830e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:16.545583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7575c3-e489-499b-b405-68d7d4e08774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.546290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7575c3-e489-499b-b405-68d7d4e08774 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.546573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7575c3-e489-499b-b405-68d7d4e08774 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.546850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7575c3-e489-499b-b405-68d7d4e08774 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.547705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7575c3-e489-499b-b405-68d7d4e08774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:16.548013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7575c3-e489-499b-b405-68d7d4e08774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.549380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7575c3-e489-499b-b405-68d7d4e08774 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.571380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 377/759] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:16.577183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfe36e-0c94-4082-8f94-b4511a69f9dd None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:16.603582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:16.741737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfe36e-0c94-4082-8f94-b4511a69f9dd None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:16.790747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233692b-a2df-43b2-881b-0ea31b7ed69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.791588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233692b-a2df-43b2-881b-0ea31b7ed69f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.791886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233692b-a2df-43b2-881b-0ea31b7ed69f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.792163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233692b-a2df-43b2-881b-0ea31b7ed69f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.804392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233692b-a2df-43b2-881b-0ea31b7ed69f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.805905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233692b-a2df-43b2-881b-0ea31b7ed69f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3233692b-a2df-43b2-881b-0ea31b7ed69f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:16.823180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:16.824182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:16.825123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:16.825123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:16.825123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:16.825123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:16.825123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:16.825123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:16.825123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:16.825123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:16.825123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:16.825123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:16.827819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 383/760] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Jun 16 14:42:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:16.832594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7575c3-e489-499b-b405-68d7d4e08774 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:16.990195 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7575c3-e489-499b-b405-68d7d4e08774 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:17.014703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:17.037438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ad7e3-d2d5-4bd8-b498-4bf405c8a58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:17.038141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ad7e3-d2d5-4bd8-b498-4bf405c8a58a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:17.038475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ad7e3-d2d5-4bd8-b498-4bf405c8a58a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:17.038756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ad7e3-d2d5-4bd8-b498-4bf405c8a58a None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:17.039593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ad7e3-d2d5-4bd8-b498-4bf405c8a58a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:17.039903 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ad7e3-d2d5-4bd8-b498-4bf405c8a58a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:17.041333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ad7e3-d2d5-4bd8-b498-4bf405c8a58a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:17.060115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 378/761] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Jun 16 14:42:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:17.065384 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233692b-a2df-43b2-881b-0ea31b7ed69f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:17.152347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbf10f-836b-4619-8792-7b8b854cc74c None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:17.152672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbf10f-836b-4619-8792-7b8b854cc74c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:17.152915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbf10f-836b-4619-8792-7b8b854cc74c None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:17.156238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 379/762] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:17.160401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f4cf-01b2-4c85-913e-e0491ca97085 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:17.160698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f4cf-01b2-4c85-913e-e0491ca97085 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:17.160985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f4cf-01b2-4c85-913e-e0491ca97085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:17.178238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:17.186121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-88c6f4cf-01b2-4c85-913e-e0491ca97085 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:17.187340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-88c6f4cf-01b2-4c85-913e-e0491ca97085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:17.218327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233692b-a2df-43b2-881b-0ea31b7ed69f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:17.263438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cf8a1-4715-4892-8519-b26408e34d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:17.264359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cf8a1-4715-4892-8519-b26408e34d25 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:17.264642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cf8a1-4715-4892-8519-b26408e34d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:17.264991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cf8a1-4715-4892-8519-b26408e34d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:17.283039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cf8a1-4715-4892-8519-b26408e34d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:17.285467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cf8a1-4715-4892-8519-b26408e34d25 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-be3cf8a1-4715-4892-8519-b26408e34d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:17.309259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:17.311002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:17.311862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:17.311862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:17.311862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:17.311862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:17.315903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 384/763] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:17.317114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cf8a1-4715-4892-8519-b26408e34d25 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:17.329186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 380/764] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:17.379673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6f4cf-01b2-4c85-913e-e0491ca97085 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:17.441645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cf8a1-4715-4892-8519-b26408e34d25 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:17.470363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:17.478524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56b3c2-ff84-4f7c-bef3-d764fa7827e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:17.479221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b3c2-ff84-4f7c-bef3-d764fa7827e8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:17.479514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b3c2-ff84-4f7c-bef3-d764fa7827e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:17.479794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b3c2-ff84-4f7c-bef3-d764fa7827e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:17.480735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56b3c2-ff84-4f7c-bef3-d764fa7827e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:17.481056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56b3c2-ff84-4f7c-bef3-d764fa7827e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:17.482933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56b3c2-ff84-4f7c-bef3-d764fa7827e8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:17.499874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 385/765] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:17.502713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56b3c2-ff84-4f7c-bef3-d764fa7827e8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:17.664629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6f4cf-01b2-4c85-913e-e0491ca97085 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:17.668650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:17.675814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56b3c2-ff84-4f7c-bef3-d764fa7827e8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:17.718689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f6291-92a4-421a-ba14-b986709c6106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:17.719729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f6291-92a4-421a-ba14-b986709c6106 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:17.720018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f6291-92a4-421a-ba14-b986709c6106 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:17.720298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f6291-92a4-421a-ba14-b986709c6106 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:17.720960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f6291-92a4-421a-ba14-b986709c6106 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:17.722731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f6291-92a4-421a-ba14-b986709c6106 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:17.724126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84426afd-399e-4a58-9daf-d0dc04f2c302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:17.725204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84426afd-399e-4a58-9daf-d0dc04f2c302 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:17.725491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84426afd-399e-4a58-9daf-d0dc04f2c302 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:17.726202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84426afd-399e-4a58-9daf-d0dc04f2c302 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:17.734684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84426afd-399e-4a58-9daf-d0dc04f2c302 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-178f6291-92a4-421a-ba14-b986709c6106 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:17.736093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:17.736964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:42:17.737870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:17.738677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84426afd-399e-4a58-9daf-d0dc04f2c302 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:17.738746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 381/766] 10.222.0.81 () {56 vars in 1129 bytes} [Thu Jun 16 14:42:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:17.739347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511b94-0fb2-4a7a-aef1-edb4e0fda3f1 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:17.739502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511b94-0fb2-4a7a-aef1-edb4e0fda3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:17.745912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511b94-0fb2-4a7a-aef1-edb4e0fda3f1 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:17.745912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 382/767] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:17.745912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d511b94-0fb2-4a7a-aef1-edb4e0fda3f1 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-84426afd-399e-4a58-9daf-d0dc04f2c302 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:17.765472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:17.767568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:17.769671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:17.769671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:17.769671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:17.769671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:17.769671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:17.769671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:17.769671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:17.769671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:17.769671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 386/768] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:17.769671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371694f6-6110-4fb2-b4e1-bc40de55003d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:17.769671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371694f6-6110-4fb2-b4e1-bc40de55003d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:17.771074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371694f6-6110-4fb2-b4e1-bc40de55003d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:17.790880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-371694f6-6110-4fb2-b4e1-bc40de55003d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:17.792502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-371694f6-6110-4fb2-b4e1-bc40de55003d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:17.838173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:17.864910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d511b94-0fb2-4a7a-aef1-edb4e0fda3f1 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:17.869961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 387/769] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:17.871096 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371694f6-6110-4fb2-b4e1-bc40de55003d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:17.902115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbce5c-d3af-4c29-9599-3289d22fa471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:17.902676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbce5c-d3af-4c29-9599-3289d22fa471 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:17.902959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbce5c-d3af-4c29-9599-3289d22fa471 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:17.903384 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbce5c-d3af-4c29-9599-3289d22fa471 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:17.904877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbce5c-d3af-4c29-9599-3289d22fa471 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:17.905188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbce5c-d3af-4c29-9599-3289d22fa471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:17.906595 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbce5c-d3af-4c29-9599-3289d22fa471 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:17.912004 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 383/770] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Jun 16 14:42:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:17.912659 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbce5c-d3af-4c29-9599-3289d22fa471 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:17.947099 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:17.991617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371694f6-6110-4fb2-b4e1-bc40de55003d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:18.024066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbce5c-d3af-4c29-9599-3289d22fa471 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:18.035995 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b13eaf-89f6-4ba9-89f5-16dd0ac6aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:18.036710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13eaf-89f6-4ba9-89f5-16dd0ac6aa57 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.037007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13eaf-89f6-4ba9-89f5-16dd0ac6aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.037284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13eaf-89f6-4ba9-89f5-16dd0ac6aa57 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.038154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b13eaf-89f6-4ba9-89f5-16dd0ac6aa57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:18.038466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b13eaf-89f6-4ba9-89f5-16dd0ac6aa57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:18.039897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b13eaf-89f6-4ba9-89f5-16dd0ac6aa57 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:18.057779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 388/771] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:18.057779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b13eaf-89f6-4ba9-89f5-16dd0ac6aa57 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:18.063458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecf256-b4af-4150-8569-7405fa608f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:18.064288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecf256-b4af-4150-8569-7405fa608f48 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.064553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecf256-b4af-4150-8569-7405fa608f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.064819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecf256-b4af-4150-8569-7405fa608f48 None admin] PATH_INFO: `/v3/services/network` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.065475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecf256-b4af-4150-8569-7405fa608f48 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:18.066885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecf256-b4af-4150-8569-7405fa608f48 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-ffecf256-b4af-4150-8569-7405fa608f48 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:18.078844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:18.079877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:18.080724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 384/772] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:17 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:18.082252 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44645848-280c-4cf0-b8f1-5c944e0e3e4e None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.082252 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44645848-280c-4cf0-b8f1-5c944e0e3e4e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.082252 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44645848-280c-4cf0-b8f1-5c944e0e3e4e None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.083270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 385/773] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:18.083949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44645848-280c-4cf0-b8f1-5c944e0e3e4e None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:18.102934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:18.175814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b13eaf-89f6-4ba9-89f5-16dd0ac6aa57 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:18.188569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:18.196959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44645848-280c-4cf0-b8f1-5c944e0e3e4e None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:18.213021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89d50d-bd76-4778-803b-b0f2f441efa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:18.214268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d50d-bd76-4778-803b-b0f2f441efa5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.214553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d50d-bd76-4778-803b-b0f2f441efa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.214828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d50d-bd76-4778-803b-b0f2f441efa5 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.215539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89d50d-bd76-4778-803b-b0f2f441efa5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:18.215847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89d50d-bd76-4778-803b-b0f2f441efa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:18.218355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89d50d-bd76-4778-803b-b0f2f441efa5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:18.229465 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 389/774] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Jun 16 14:42:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:18.229465 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89d50d-bd76-4778-803b-b0f2f441efa5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:18.239122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301979d4-eb87-4bb1-b6f5-7c2a2cef5e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:18.240015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301979d4-eb87-4bb1-b6f5-7c2a2cef5e1a None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.240340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301979d4-eb87-4bb1-b6f5-7c2a2cef5e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.240726 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301979d4-eb87-4bb1-b6f5-7c2a2cef5e1a None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/f2faa046b0294a0ba1090be84bb1cebc/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.242756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301979d4-eb87-4bb1-b6f5-7c2a2cef5e1a None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=f2faa046b0294a0ba1090be84bb1cebc, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:18.244443 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301979d4-eb87-4bb1-b6f5-7c2a2cef5e1a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:18.258498 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 386/775] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:18 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/f2faa046b0294a0ba1090be84bb1cebc/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:18.259781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c15a07-ff6b-4aff-a1b6-af8ceb67db70 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.260066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c15a07-ff6b-4aff-a1b6-af8ceb67db70 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.260341 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c15a07-ff6b-4aff-a1b6-af8ceb67db70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.282943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a2c15a07-ff6b-4aff-a1b6-af8ceb67db70 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:18.284166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a2c15a07-ff6b-4aff-a1b6-af8ceb67db70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:18.365746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:18.377840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 387/776] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:18.377840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c15a07-ff6b-4aff-a1b6-af8ceb67db70 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:18.378127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89d50d-bd76-4778-803b-b0f2f441efa5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:18.438988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24681bc-d2d3-4f51-8c1f-f967b47330ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:18.440056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24681bc-d2d3-4f51-8c1f-f967b47330ef None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.440624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24681bc-d2d3-4f51-8c1f-f967b47330ef None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.441102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24681bc-d2d3-4f51-8c1f-f967b47330ef None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.442242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24681bc-d2d3-4f51-8c1f-f967b47330ef None admin] RBAC: Adding query filter params (name=network) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:18.442762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24681bc-d2d3-4f51-8c1f-f967b47330ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:18.445153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24681bc-d2d3-4f51-8c1f-f967b47330ef None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:18.451865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 390/777] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:18.452943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24681bc-d2d3-4f51-8c1f-f967b47330ef None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:18.490640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:18.512042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c15a07-ff6b-4aff-a1b6-af8ceb67db70 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:18.548857 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d021-dcca-495b-8f14-d5cf4ff7593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:18.549900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d021-dcca-495b-8f14-d5cf4ff7593e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.549900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d021-dcca-495b-8f14-d5cf4ff7593e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.550164 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d021-dcca-495b-8f14-d5cf4ff7593e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.550923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3d021-dcca-495b-8f14-d5cf4ff7593e None admin] RBAC: Adding query filter params (interface=public, service_id=2ed15cd8512345cb80f6d76d0cac7c91, region_id=RegionOne) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:18.551240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3d021-dcca-495b-8f14-d5cf4ff7593e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:18.552809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3d021-dcca-495b-8f14-d5cf4ff7593e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:18.565219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 388/778] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Jun 16 14:42:18 2022] GET /identity/v3/endpoints?service_id=2ed15cd8512345cb80f6d76d0cac7c91&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:18.566238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d021-dcca-495b-8f14-d5cf4ff7593e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:18.579369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24681bc-d2d3-4f51-8c1f-f967b47330ef None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:18.616656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c3943-15bc-4213-be5f-41edd20bd22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:18.617977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3943-15bc-4213-be5f-41edd20bd22f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.618494 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3943-15bc-4213-be5f-41edd20bd22f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.619064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3943-15bc-4213-be5f-41edd20bd22f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.632565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c3943-15bc-4213-be5f-41edd20bd22f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-da6c3943-15bc-4213-be5f-41edd20bd22f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:18.642036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:18.643160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:18.644002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:18.647128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 391/779] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:18.664604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c3943-15bc-4213-be5f-41edd20bd22f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:18.680987 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d021-dcca-495b-8f14-d5cf4ff7593e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:18.703545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:18.718425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c34a2-5471-4acc-b1dd-74699e05cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:18.719256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c34a2-5471-4acc-b1dd-74699e05cb84 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.719547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c34a2-5471-4acc-b1dd-74699e05cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.719826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c34a2-5471-4acc-b1dd-74699e05cb84 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.720538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c34a2-5471-4acc-b1dd-74699e05cb84 None admin] RBAC: Adding query filter params (type=network) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:18.720847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c34a2-5471-4acc-b1dd-74699e05cb84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:18.722255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c34a2-5471-4acc-b1dd-74699e05cb84 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:18.727593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 389/780] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:18.728452 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c34a2-5471-4acc-b1dd-74699e05cb84 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:18.748151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:18.782751 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c3943-15bc-4213-be5f-41edd20bd22f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:18.820216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ebd8d-965a-48dc-90d3-b43cfd98d5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:18.820884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ebd8d-965a-48dc-90d3-b43cfd98d5cb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.821174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ebd8d-965a-48dc-90d3-b43cfd98d5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.821452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ebd8d-965a-48dc-90d3-b43cfd98d5cb None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.822169 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ebd8d-965a-48dc-90d3-b43cfd98d5cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:18.823537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ebd8d-965a-48dc-90d3-b43cfd98d5cb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:18.836291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 392/781] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Jun 16 14:42:18 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:18.836291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03626f-5646-4865-9b39-de42c8656b30 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.836291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03626f-5646-4865-9b39-de42c8656b30 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.836291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03626f-5646-4865-9b39-de42c8656b30 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.836291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 393/782] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:18.837358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03626f-5646-4865-9b39-de42c8656b30 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:18.854415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c34a2-5471-4acc-b1dd-74699e05cb84 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:18.896537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1efa-6602-4d58-883c-82841c21117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:18.897224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1efa-6602-4d58-883c-82841c21117c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.897564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1efa-6602-4d58-883c-82841c21117c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.897921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1efa-6602-4d58-883c-82841c21117c None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.898700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1efa-6602-4d58-883c-82841c21117c None admin] RBAC: Adding query filter params (name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:18.899059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1efa-6602-4d58-883c-82841c21117c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:18.900742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1efa-6602-4d58-883c-82841c21117c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:18.916996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 390/783] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:18.916996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4284-9b97-4aad-ac94-033d90beb64a None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:18.916996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4284-9b97-4aad-ac94-033d90beb64a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:18.916996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4284-9b97-4aad-ac94-033d90beb64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:18.936955 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b64c4284-9b97-4aad-ac94-033d90beb64a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:18.938527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b64c4284-9b97-4aad-ac94-033d90beb64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:18.963039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:18.990795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03626f-5646-4865-9b39-de42c8656b30 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.032888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 391/784] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:19.034480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c4284-9b97-4aad-ac94-033d90beb64a None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.044588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:19.047766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12692817-6bdc-4525-8e64-7e6d7209bc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.049863 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692817-6bdc-4525-8e64-7e6d7209bc95 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.050361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692817-6bdc-4525-8e64-7e6d7209bc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.051243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692817-6bdc-4525-8e64-7e6d7209bc95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.052543 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12692817-6bdc-4525-8e64-7e6d7209bc95 None admin] RBAC: Adding query filter params (interface=public, service_id=6bc6238b4e7c423f80a1a4e2c398015f, region_id=RegionOne) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:19.053042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12692817-6bdc-4525-8e64-7e6d7209bc95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:19.055416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12692817-6bdc-4525-8e64-7e6d7209bc95 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:19.066672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 394/785] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Jun 16 14:42:18 2022] GET /identity/v3/endpoints?service_id=6bc6238b4e7c423f80a1a4e2c398015f&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:19.067777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12692817-6bdc-4525-8e64-7e6d7209bc95 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.154601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c4284-9b97-4aad-ac94-033d90beb64a None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.191428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a5b8a-34d4-468d-a0ba-9dc52f383237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.194016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a5b8a-34d4-468d-a0ba-9dc52f383237 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.194016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a5b8a-34d4-468d-a0ba-9dc52f383237 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.194016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a5b8a-34d4-468d-a0ba-9dc52f383237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.202250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12692817-6bdc-4525-8e64-7e6d7209bc95 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.210000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a5b8a-34d4-468d-a0ba-9dc52f383237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:19.212118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a5b8a-34d4-468d-a0ba-9dc52f383237 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-6d9a5b8a-34d4-468d-a0ba-9dc52f383237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:19.237428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:19.238623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:19.240081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:19.240081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:19.240081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:19.240081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:19.245419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 392/786] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:19.245419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a5b8a-34d4-468d-a0ba-9dc52f383237 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.251182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98530fe-afe6-477e-ab66-3c2eca66db72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.253003 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98530fe-afe6-477e-ab66-3c2eca66db72 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.253505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98530fe-afe6-477e-ab66-3c2eca66db72 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.254011 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98530fe-afe6-477e-ab66-3c2eca66db72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.269651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98530fe-afe6-477e-ab66-3c2eca66db72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f98530fe-afe6-477e-ab66-3c2eca66db72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:19.281104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:19.282170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:19.283078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:19.286886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 395/787] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:19.287884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98530fe-afe6-477e-ab66-3c2eca66db72 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.304702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:19.330343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:19.385861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a5b8a-34d4-468d-a0ba-9dc52f383237 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.422909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98530fe-afe6-477e-ab66-3c2eca66db72 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.436668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a12fc-d0c5-49be-b1a2-9e590d1d4774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.437527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a12fc-d0c5-49be-b1a2-9e590d1d4774 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.438356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a12fc-d0c5-49be-b1a2-9e590d1d4774 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.438738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a12fc-d0c5-49be-b1a2-9e590d1d4774 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.439814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a12fc-d0c5-49be-b1a2-9e590d1d4774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:19.441570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a12fc-d0c5-49be-b1a2-9e590d1d4774 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:19.454116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 393/788] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:19.455349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a12fc-d0c5-49be-b1a2-9e590d1d4774 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.492879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff697f5-af00-455c-95a8-925e5c61d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.493808 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff697f5-af00-455c-95a8-925e5c61d22b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.494123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff697f5-af00-455c-95a8-925e5c61d22b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.494621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff697f5-af00-455c-95a8-925e5c61d22b None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.495364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff697f5-af00-455c-95a8-925e5c61d22b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:19.495672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff697f5-af00-455c-95a8-925e5c61d22b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:19.499374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff697f5-af00-455c-95a8-925e5c61d22b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:19.529999 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 396/789] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:19.536644 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff697f5-af00-455c-95a8-925e5c61d22b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.715106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a12fc-d0c5-49be-b1a2-9e590d1d4774 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.744072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:19.764522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:19.771558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750e71-89aa-400b-aadb-413937fc0e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.772256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750e71-89aa-400b-aadb-413937fc0e03 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.772538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750e71-89aa-400b-aadb-413937fc0e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.772813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750e71-89aa-400b-aadb-413937fc0e03 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.773564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c750e71-89aa-400b-aadb-413937fc0e03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:19.773871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c750e71-89aa-400b-aadb-413937fc0e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:19.775278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c750e71-89aa-400b-aadb-413937fc0e03 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:19.794065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 394/790] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:19.797577 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750e71-89aa-400b-aadb-413937fc0e03 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.840822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff697f5-af00-455c-95a8-925e5c61d22b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.925664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750e71-89aa-400b-aadb-413937fc0e03 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.962825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ee5c3-5019-4393-937f-8b98922f2dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.963971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee5c3-5019-4393-937f-8b98922f2dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.964474 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee5c3-5019-4393-937f-8b98922f2dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.964946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee5c3-5019-4393-937f-8b98922f2dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.976537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a20f6-e89e-4da9-80d5-e4facd0f4efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.977371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a20f6-e89e-4da9-80d5-e4facd0f4efc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.977651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a20f6-e89e-4da9-80d5-e4facd0f4efc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.978024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a20f6-e89e-4da9-80d5-e4facd0f4efc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.978773 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ee5c3-5019-4393-937f-8b98922f2dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:19.980522 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ee5c3-5019-4393-937f-8b98922f2dd6 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-bc0ee5c3-5019-4393-937f-8b98922f2dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:20.004187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:20.005129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:20.006082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:20.006082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:20.006082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:20.006082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:20.008320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a20f6-e89e-4da9-80d5-e4facd0f4efc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.008562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 395/791] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:20.009780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a20f6-e89e-4da9-80d5-e4facd0f4efc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.021916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ee5c3-5019-4393-937f-8b98922f2dd6 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-6a5a20f6-e89e-4da9-80d5-e4facd0f4efc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:20.047467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:20.048461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:20.049420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:20.049420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:20.049420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:20.049420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:20.049420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:20.049420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:20.049420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:20.049420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:20.049420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:20.049420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:20.049420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 397/792] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 511 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:20.055550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a20f6-e89e-4da9-80d5-e4facd0f4efc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.107519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.215474 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a20f6-e89e-4da9-80d5-e4facd0f4efc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.255416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.268918 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858e8ae-a50b-4599-8682-ae02631d1b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.270766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858e8ae-a50b-4599-8682-ae02631d1b8d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.271258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858e8ae-a50b-4599-8682-ae02631d1b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.271744 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858e8ae-a50b-4599-8682-ae02631d1b8d None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.275751 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858e8ae-a50b-4599-8682-ae02631d1b8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:20.277289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858e8ae-a50b-4599-8682-ae02631d1b8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.281583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858e8ae-a50b-4599-8682-ae02631d1b8d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.305147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ee5c3-5019-4393-937f-8b98922f2dd6 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.317230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 398/793] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:20.321452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858e8ae-a50b-4599-8682-ae02631d1b8d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.370130 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2f046-d032-4f54-8b79-a1eae89911fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.371160 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f046-d032-4f54-8b79-a1eae89911fb None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.373225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f046-d032-4f54-8b79-a1eae89911fb None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.373714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f046-d032-4f54-8b79-a1eae89911fb None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.374700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2f046-d032-4f54-8b79-a1eae89911fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:20.375946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2f046-d032-4f54-8b79-a1eae89911fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.377565 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2f046-d032-4f54-8b79-a1eae89911fb None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.402775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 396/794] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:20.412216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2f046-d032-4f54-8b79-a1eae89911fb None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.511755 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858e8ae-a50b-4599-8682-ae02631d1b8d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.582887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce376a3-7772-4117-9ccd-d160ac689c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.584026 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce376a3-7772-4117-9ccd-d160ac689c08 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.584588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce376a3-7772-4117-9ccd-d160ac689c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.585082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce376a3-7772-4117-9ccd-d160ac689c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.602242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.602578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce376a3-7772-4117-9ccd-d160ac689c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.605369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce376a3-7772-4117-9ccd-d160ac689c08 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.611748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2f046-d032-4f54-8b79-a1eae89911fb None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-9ce376a3-7772-4117-9ccd-d160ac689c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:20.629114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:20.630109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:20.631015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:20.631015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:20.631015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:20.631015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:20.631015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 399/795] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:20.631936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7fb4-4952-4f24-ba29-66159cedc356 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.632218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7fb4-4952-4f24-ba29-66159cedc356 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.632507 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7fb4-4952-4f24-ba29-66159cedc356 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.634068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 400/796] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:20.641248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ba0f7-a34e-4eb4-a04d-d1c2a7bab96f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.641684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ba0f7-a34e-4eb4-a04d-d1c2a7bab96f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.642159 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ba0f7-a34e-4eb4-a04d-d1c2a7bab96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.663493 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52936ad-cc6e-43fe-a8bf-a520117ef410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.664323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52936ad-cc6e-43fe-a8bf-a520117ef410 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.664598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52936ad-cc6e-43fe-a8bf-a520117ef410 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.664874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52936ad-cc6e-43fe-a8bf-a520117ef410 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.672500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-aa1ba0f7-a34e-4eb4-a04d-d1c2a7bab96f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:20.672944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52936ad-cc6e-43fe-a8bf-a520117ef410 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.674305 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-aa1ba0f7-a34e-4eb4-a04d-d1c2a7bab96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:20.674490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52936ad-cc6e-43fe-a8bf-a520117ef410 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-c52936ad-cc6e-43fe-a8bf-a520117ef410 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:20.690959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:20.691947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:20.692874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:20.692874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:20.692874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:20.692874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:20.692874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:20.692874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:20.692874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:20.692874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:20.692874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:42:20.692874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:20.692874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 397/797] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:20.693454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52936ad-cc6e-43fe-a8bf-a520117ef410 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.720307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.769905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 401/798] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:42:20.769905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ba0f7-a34e-4eb4-a04d-d1c2a7bab96f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.850285 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52936ad-cc6e-43fe-a8bf-a520117ef410 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.894931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d57a5-e635-45c3-8b73-cb1a68e8423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.895862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d57a5-e635-45c3-8b73-cb1a68e8423a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.896147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d57a5-e635-45c3-8b73-cb1a68e8423a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.896426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d57a5-e635-45c3-8b73-cb1a68e8423a None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.897155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d57a5-e635-45c3-8b73-cb1a68e8423a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:20.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d57a5-e635-45c3-8b73-cb1a68e8423a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.899793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d57a5-e635-45c3-8b73-cb1a68e8423a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.909002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ba0f7-a34e-4eb4-a04d-d1c2a7bab96f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.916158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 398/799] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:20.917138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d57a5-e635-45c3-8b73-cb1a68e8423a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.944060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.952845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be22b6-1a55-4cb0-bcb3-c51fa0aa2bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.953630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be22b6-1a55-4cb0-bcb3-c51fa0aa2bde None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.954009 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be22b6-1a55-4cb0-bcb3-c51fa0aa2bde None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.954356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be22b6-1a55-4cb0-bcb3-c51fa0aa2bde None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.955286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be22b6-1a55-4cb0-bcb3-c51fa0aa2bde None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:20.955665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be22b6-1a55-4cb0-bcb3-c51fa0aa2bde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.957231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be22b6-1a55-4cb0-bcb3-c51fa0aa2bde None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.977547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 402/800] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:20.978546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be22b6-1a55-4cb0-bcb3-c51fa0aa2bde None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.010145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.048073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d57a5-e635-45c3-8b73-cb1a68e8423a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.087987 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a3257-7db8-4241-9b46-e5799be4c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.089033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be22b6-1a55-4cb0-bcb3-c51fa0aa2bde None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.089413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a3257-7db8-4241-9b46-e5799be4c723 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.089947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a3257-7db8-4241-9b46-e5799be4c723 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.090705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a3257-7db8-4241-9b46-e5799be4c723 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.105919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a3257-7db8-4241-9b46-e5799be4c723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-a95a3257-7db8-4241-9b46-e5799be4c723 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:21.115737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:21.116678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:21.117517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:21.125303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 399/801] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:21.125303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a3257-7db8-4241-9b46-e5799be4c723 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.142514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922b6e6-5890-4022-93ac-1b59617aa2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.144451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922b6e6-5890-4022-93ac-1b59617aa2ea None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.145095 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922b6e6-5890-4022-93ac-1b59617aa2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.145667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922b6e6-5890-4022-93ac-1b59617aa2ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.155986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922b6e6-5890-4022-93ac-1b59617aa2ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.158230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922b6e6-5890-4022-93ac-1b59617aa2ea None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-2922b6e6-5890-4022-93ac-1b59617aa2ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:21.177411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:21.178349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:21.179239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:21.179239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:21.179239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:21.179239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:21.179239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:21.179239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:21.179239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:21.179239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:21.182054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 403/802] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:21.183321 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922b6e6-5890-4022-93ac-1b59617aa2ea None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.227754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.258764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a3257-7db8-4241-9b46-e5799be4c723 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.298310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b9b27-95cc-4719-92ac-92f847ad138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.299122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b9b27-95cc-4719-92ac-92f847ad138f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.299403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b9b27-95cc-4719-92ac-92f847ad138f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.299675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b9b27-95cc-4719-92ac-92f847ad138f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.305470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.310913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b9b27-95cc-4719-92ac-92f847ad138f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.312471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b9b27-95cc-4719-92ac-92f847ad138f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.319330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922b6e6-5890-4022-93ac-1b59617aa2ea None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-118b9b27-95cc-4719-92ac-92f847ad138f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:21.331661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:21.332594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:21.333468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:21.333468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:21.333468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:21.333468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:21.333468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 400/803] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:21.334373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b9b27-95cc-4719-92ac-92f847ad138f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.362437 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d6bc1-cc5c-4695-8706-b41469cf8430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.363041 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d6bc1-cc5c-4695-8706-b41469cf8430 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.363344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d6bc1-cc5c-4695-8706-b41469cf8430 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.363597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d6bc1-cc5c-4695-8706-b41469cf8430 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.364339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d6bc1-cc5c-4695-8706-b41469cf8430 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:21.364650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d6bc1-cc5c-4695-8706-b41469cf8430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.366053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d6bc1-cc5c-4695-8706-b41469cf8430 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.379811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 404/804] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:21.379811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9e18c-7bd2-4aa5-8edb-2d936a3de519 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.379811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9e18c-7bd2-4aa5-8edb-2d936a3de519 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.379811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9e18c-7bd2-4aa5-8edb-2d936a3de519 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.379811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 405/805] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:21.379811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9e18c-7bd2-4aa5-8edb-2d936a3de519 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.446677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b9b27-95cc-4719-92ac-92f847ad138f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.476934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.486068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa0a63-b7b7-4c8b-b590-690b1331eed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.486745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa0a63-b7b7-4c8b-b590-690b1331eed3 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.487029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa0a63-b7b7-4c8b-b590-690b1331eed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.487312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa0a63-b7b7-4c8b-b590-690b1331eed3 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.488094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa0a63-b7b7-4c8b-b590-690b1331eed3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:21.488405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa0a63-b7b7-4c8b-b590-690b1331eed3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.489825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa0a63-b7b7-4c8b-b590-690b1331eed3 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.493164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9e18c-7bd2-4aa5-8edb-2d936a3de519 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.507606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 401/806] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:21.507606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa0a63-b7b7-4c8b-b590-690b1331eed3 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.537089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caa108-6843-4ca1-869e-e13b9c0eb65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.537774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caa108-6843-4ca1-869e-e13b9c0eb65a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.538070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caa108-6843-4ca1-869e-e13b9c0eb65a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.538351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caa108-6843-4ca1-869e-e13b9c0eb65a None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.539064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caa108-6843-4ca1-869e-e13b9c0eb65a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:21.539374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caa108-6843-4ca1-869e-e13b9c0eb65a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.540738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caa108-6843-4ca1-869e-e13b9c0eb65a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.553626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 406/807] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:21.559285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a83bfa-288b-4c5a-888c-22d5b945c88c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.559605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a83bfa-288b-4c5a-888c-22d5b945c88c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.559986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a83bfa-288b-4c5a-888c-22d5b945c88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.578370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-41a83bfa-288b-4c5a-888c-22d5b945c88c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:21.579558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-41a83bfa-288b-4c5a-888c-22d5b945c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:21.582520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.614834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa0a63-b7b7-4c8b-b590-690b1331eed3 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.657909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 407/808] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:21.657909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a83bfa-288b-4c5a-888c-22d5b945c88c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.661540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cf25c-6be2-446a-8848-4ebc3eea4f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.662465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf25c-6be2-446a-8848-4ebc3eea4f1b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.662747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf25c-6be2-446a-8848-4ebc3eea4f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.663033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf25c-6be2-446a-8848-4ebc3eea4f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.678783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf25c-6be2-446a-8848-4ebc3eea4f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.680269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf25c-6be2-446a-8848-4ebc3eea4f1b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-6b9cf25c-6be2-446a-8848-4ebc3eea4f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:21.699856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:21.705864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:21.707063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:21.707063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:21.707063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:21.707063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:21.707063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 402/809] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:21.707063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cf25c-6be2-446a-8848-4ebc3eea4f1b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.749249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.773101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a83bfa-288b-4c5a-888c-22d5b945c88c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.808101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576e7ad-2c63-48af-8fad-20e0fb7fa1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.809143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576e7ad-2c63-48af-8fad-20e0fb7fa1b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.809552 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576e7ad-2c63-48af-8fad-20e0fb7fa1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.810384 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576e7ad-2c63-48af-8fad-20e0fb7fa1b2 None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/7255df373d794cf8b2548b3c0876dd22/roles/6e6c598a68fa410f949be49b804af3f5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.813219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cf25c-6be2-446a-8848-4ebc3eea4f1b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.821754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.827796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576e7ad-2c63-48af-8fad-20e0fb7fa1b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=7255df373d794cf8b2548b3c0876dd22, role_id=6e6c598a68fa410f949be49b804af3f5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.829246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576e7ad-2c63-48af-8fad-20e0fb7fa1b2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.849992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 408/810] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:21 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/7255df373d794cf8b2548b3c0876dd22/roles/6e6c598a68fa410f949be49b804af3f5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:21.849992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576e7ad-2c63-48af-8fad-20e0fb7fa1b2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.868378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6275e-357d-4d15-a2ee-a3b3497bfff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.869111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6275e-357d-4d15-a2ee-a3b3497bfff8 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.869400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6275e-357d-4d15-a2ee-a3b3497bfff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.869677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6275e-357d-4d15-a2ee-a3b3497bfff8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.878271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6275e-357d-4d15-a2ee-a3b3497bfff8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.879783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6275e-357d-4d15-a2ee-a3b3497bfff8 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-20e6275e-357d-4d15-a2ee-a3b3497bfff8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:21.896580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:21.897695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:21.898600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:21.898600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:21.898600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:21.898600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:21.898600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:21.898600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:21.898600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:21.898600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:21.902732 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 403/811] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:21.903690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6275e-357d-4d15-a2ee-a3b3497bfff8 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.981533 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576e7ad-2c63-48af-8fad-20e0fb7fa1b2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.029625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33fe25-a904-4453-8e7a-858460793398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.030712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33fe25-a904-4453-8e7a-858460793398 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.031100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33fe25-a904-4453-8e7a-858460793398 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.031477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33fe25-a904-4453-8e7a-858460793398 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.032263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33fe25-a904-4453-8e7a-858460793398 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.033806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33fe25-a904-4453-8e7a-858460793398 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-1e33fe25-a904-4453-8e7a-858460793398 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:22.050886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:22.051919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:22.052734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 409/812] 10.222.0.81 () {56 vars in 1129 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:22.053582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33fe25-a904-4453-8e7a-858460793398 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.117075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:22.167537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33fe25-a904-4453-8e7a-858460793398 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.169933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:22.174013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6275e-357d-4d15-a2ee-a3b3497bfff8 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.207629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ab997-5484-4b2e-98c3-1c53d7f721e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.208684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab997-5484-4b2e-98c3-1c53d7f721e4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.209118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab997-5484-4b2e-98c3-1c53d7f721e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.209267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221f32d-c54a-4ecc-b378-cd07c99508bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.209698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab997-5484-4b2e-98c3-1c53d7f721e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.209954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f32d-c54a-4ecc-b378-cd07c99508bb None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.210242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f32d-c54a-4ecc-b378-cd07c99508bb None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.210520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f32d-c54a-4ecc-b378-cd07c99508bb None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.211145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ab997-5484-4b2e-98c3-1c53d7f721e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:22.211270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221f32d-c54a-4ecc-b378-cd07c99508bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:22.211537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221f32d-c54a-4ecc-b378-cd07c99508bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.211853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ab997-5484-4b2e-98c3-1c53d7f721e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.212904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221f32d-c54a-4ecc-b378-cd07c99508bb None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.213622 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ab997-5484-4b2e-98c3-1c53d7f721e4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.225021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 404/813] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:22.226384 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2e824-4e0d-4cc5-b0f2-395c40f75254 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.226672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2e824-4e0d-4cc5-b0f2-395c40f75254 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.226950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2e824-4e0d-4cc5-b0f2-395c40f75254 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.230407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 405/814] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:22.230407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2e824-4e0d-4cc5-b0f2-395c40f75254 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.241123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 410/815] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:22.242033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ab997-5484-4b2e-98c3-1c53d7f721e4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.350653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2e824-4e0d-4cc5-b0f2-395c40f75254 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.390825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbb958-e67f-454f-a0b8-a317997bcf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.391501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbb958-e67f-454f-a0b8-a317997bcf69 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.391780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbb958-e67f-454f-a0b8-a317997bcf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.392052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbb958-e67f-454f-a0b8-a317997bcf69 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.392758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbb958-e67f-454f-a0b8-a317997bcf69 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:22.393062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbb958-e67f-454f-a0b8-a317997bcf69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.394479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbb958-e67f-454f-a0b8-a317997bcf69 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.404764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 406/816] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Jun 16 14:42:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:22.404764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f9e5b-0a69-4e30-9658-2f17b3d969bc None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.404764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f9e5b-0a69-4e30-9658-2f17b3d969bc None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.404764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f9e5b-0a69-4e30-9658-2f17b3d969bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.421377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-154f9e5b-0a69-4e30-9658-2f17b3d969bc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:22.422521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-154f9e5b-0a69-4e30-9658-2f17b3d969bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:22.442903 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:22.469254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ab997-5484-4b2e-98c3-1c53d7f721e4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.484959 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:22.509908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 407/817] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:22.509908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f9e5b-0a69-4e30-9658-2f17b3d969bc None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.521015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ce5e2-25fb-405e-ac6a-5ff3feb85c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.521927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ce5e2-25fb-405e-ac6a-5ff3feb85c9d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.522275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ce5e2-25fb-405e-ac6a-5ff3feb85c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.522677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ce5e2-25fb-405e-ac6a-5ff3feb85c9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.531169 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ce5e2-25fb-405e-ac6a-5ff3feb85c9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.532638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ce5e2-25fb-405e-ac6a-5ff3feb85c9d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-e58ce5e2-25fb-405e-ac6a-5ff3feb85c9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:22.548006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:22.548979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:22.549920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:22.549920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:22.549920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:22.549920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:22.549920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:22.549920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:22.549920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:22.549920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:22.549920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:22.549920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:22.549920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 411/818] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Jun 16 14:42:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:22.550528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ce5e2-25fb-405e-ac6a-5ff3feb85c9d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.637735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f9e5b-0a69-4e30-9658-2f17b3d969bc None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.661943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ce5e2-25fb-405e-ac6a-5ff3feb85c9d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.680369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a40df-3f64-4336-aa31-d12456370464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.681191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a40df-3f64-4336-aa31-d12456370464 None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.681472 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a40df-3f64-4336-aa31-d12456370464 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.681748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a40df-3f64-4336-aa31-d12456370464 None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/c0e6fc45641f4c279def2d4aa971978d/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.683874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a40df-3f64-4336-aa31-d12456370464 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=c0e6fc45641f4c279def2d4aa971978d, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.685952 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a40df-3f64-4336-aa31-d12456370464 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.709915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 408/819] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:22 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/c0e6fc45641f4c279def2d4aa971978d/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:22.709915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a40df-3f64-4336-aa31-d12456370464 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.719028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:22.727255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0d608-4e8c-42f1-a6fe-1cfb2f7c21c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.729432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0d608-4e8c-42f1-a6fe-1cfb2f7c21c5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.730013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0d608-4e8c-42f1-a6fe-1cfb2f7c21c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.730318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0d608-4e8c-42f1-a6fe-1cfb2f7c21c5 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.731158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0d608-4e8c-42f1-a6fe-1cfb2f7c21c5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:22.732312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0d608-4e8c-42f1-a6fe-1cfb2f7c21c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.734829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0d608-4e8c-42f1-a6fe-1cfb2f7c21c5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.746061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 412/820] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Jun 16 14:42:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:22.747030 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0d608-4e8c-42f1-a6fe-1cfb2f7c21c5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.796398 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:22.830022 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a40df-3f64-4336-aa31-d12456370464 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.866879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0d608-4e8c-42f1-a6fe-1cfb2f7c21c5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.868858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb250bef-583e-433d-951f-02d188d98331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.869631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb250bef-583e-433d-951f-02d188d98331 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.869943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb250bef-583e-433d-951f-02d188d98331 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.870230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb250bef-583e-433d-951f-02d188d98331 None admin] PATH_INFO: `/v3/services/network` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.870904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb250bef-583e-433d-951f-02d188d98331 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.872433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb250bef-583e-433d-951f-02d188d98331 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-eb250bef-583e-433d-951f-02d188d98331 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:22.885564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:22.886655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:42:22.887728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:22.890024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 409/821] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:22 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:22.891233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb250bef-583e-433d-951f-02d188d98331 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.915436 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9954d0-9c6a-4c7f-9a46-b5c6d32b9dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.916400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9954d0-9c6a-4c7f-9a46-b5c6d32b9dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.916819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9954d0-9c6a-4c7f-9a46-b5c6d32b9dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.917470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9954d0-9c6a-4c7f-9a46-b5c6d32b9dd9 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.918633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9954d0-9c6a-4c7f-9a46-b5c6d32b9dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:22.919084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9954d0-9c6a-4c7f-9a46-b5c6d32b9dd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.921706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9954d0-9c6a-4c7f-9a46-b5c6d32b9dd9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.941510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 413/822] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Jun 16 14:42:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:22.942303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9954d0-9c6a-4c7f-9a46-b5c6d32b9dd9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.997609 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:23.026159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb250bef-583e-433d-951f-02d188d98331 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:23.061908 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:23.064212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9954d0-9c6a-4c7f-9a46-b5c6d32b9dd9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:23.067192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3fa87-92bb-4c0b-94b6-a538eeeca72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:23.067858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fa87-92bb-4c0b-94b6-a538eeeca72a None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:23.068135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fa87-92bb-4c0b-94b6-a538eeeca72a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:23.068406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fa87-92bb-4c0b-94b6-a538eeeca72a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:23.069140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3fa87-92bb-4c0b-94b6-a538eeeca72a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:23.070588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3fa87-92bb-4c0b-94b6-a538eeeca72a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:23.096694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 410/823] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Jun 16 14:42:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:23.097876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3fa87-92bb-4c0b-94b6-a538eeeca72a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:23.128546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166fbed-d4cb-4730-94a4-a10aca07b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:23.129783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166fbed-d4cb-4730-94a4-a10aca07b187 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:23.130132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166fbed-d4cb-4730-94a4-a10aca07b187 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:23.130672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166fbed-d4cb-4730-94a4-a10aca07b187 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:23.131512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166fbed-d4cb-4730-94a4-a10aca07b187 None admin] RBAC: Adding query filter params (name=network) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:23.132085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166fbed-d4cb-4730-94a4-a10aca07b187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:23.134243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166fbed-d4cb-4730-94a4-a10aca07b187 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:23.142302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 414/824] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:23.155510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166fbed-d4cb-4730-94a4-a10aca07b187 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:23.315751 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3fa87-92bb-4c0b-94b6-a538eeeca72a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:23.322210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166fbed-d4cb-4730-94a4-a10aca07b187 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:23.377002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bce08-b948-440a-87bc-ee7e82e4358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:23.377667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bce08-b948-440a-87bc-ee7e82e4358c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:23.377968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bce08-b948-440a-87bc-ee7e82e4358c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:23.378244 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bce08-b948-440a-87bc-ee7e82e4358c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:23.382316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642de10-fc58-418d-a080-1fdc11d1047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:23.382980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642de10-fc58-418d-a080-1fdc11d1047e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:23.383312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642de10-fc58-418d-a080-1fdc11d1047e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:23.383588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642de10-fc58-418d-a080-1fdc11d1047e None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:23.384288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642de10-fc58-418d-a080-1fdc11d1047e None admin] RBAC: Adding query filter params (type=network) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:23.384588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642de10-fc58-418d-a080-1fdc11d1047e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:23.386136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642de10-fc58-418d-a080-1fdc11d1047e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:23.386263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:23.398322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 415/825] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:23.410861 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642de10-fc58-418d-a080-1fdc11d1047e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:23.446238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:23.526045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bce08-b948-440a-87bc-ee7e82e4358c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:23.527517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bce08-b948-440a-87bc-ee7e82e4358c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:23.596759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642de10-fc58-418d-a080-1fdc11d1047e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:23.675363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 411/826] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:42:23.682894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bce08-b948-440a-87bc-ee7e82e4358c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:23.718959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:23.727196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0bbd2-031c-4a17-9e88-b0c9b64c2007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:23.727873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0bbd2-031c-4a17-9e88-b0c9b64c2007 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:23.728149 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0bbd2-031c-4a17-9e88-b0c9b64c2007 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:23.728419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0bbd2-031c-4a17-9e88-b0c9b64c2007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:23.729157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0bbd2-031c-4a17-9e88-b0c9b64c2007 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:23.733913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0bbd2-031c-4a17-9e88-b0c9b64c2007 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:23.755949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 416/827] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Jun 16 14:42:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:23.847845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bce08-b948-440a-87bc-ee7e82e4358c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:23.923491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6037344-e680-4c70-9a79-ee60fd873016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:23.924307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6037344-e680-4c70-9a79-ee60fd873016 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:23.924590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6037344-e680-4c70-9a79-ee60fd873016 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:23.924899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6037344-e680-4c70-9a79-ee60fd873016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:23.948253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6037344-e680-4c70-9a79-ee60fd873016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:23.949772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6037344-e680-4c70-9a79-ee60fd873016 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-d6037344-e680-4c70-9a79-ee60fd873016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:23.975216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:23.976169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:23.977061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:23.977061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:23.977061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:23.977061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:23.977061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 412/828] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:23.983639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0bbd2-031c-4a17-9e88-b0c9b64c2007 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.092210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:24.105201 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0bbd2-031c-4a17-9e88-b0c9b64c2007 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:24.146209 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433a2a2-efda-4d11-a4a8-d57d4523bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:24.147278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a2a2-efda-4d11-a4a8-d57d4523bd9d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.147762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a2a2-efda-4d11-a4a8-d57d4523bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.148218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a2a2-efda-4d11-a4a8-d57d4523bd9d None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.149594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433a2a2-efda-4d11-a4a8-d57d4523bd9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:24.154286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433a2a2-efda-4d11-a4a8-d57d4523bd9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:24.156804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433a2a2-efda-4d11-a4a8-d57d4523bd9d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:24.170566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 417/829] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:24.179112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6037344-e680-4c70-9a79-ee60fd873016 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.284639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328760-9007-4782-b26a-b95a8cf04a46 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.284991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328760-9007-4782-b26a-b95a8cf04a46 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.285204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328760-9007-4782-b26a-b95a8cf04a46 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.289074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 418/830] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:24.293873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:24.294752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe038139-d1db-454e-a3ad-5329f2774270 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.295048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe038139-d1db-454e-a3ad-5329f2774270 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.295605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe038139-d1db-454e-a3ad-5329f2774270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.316879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6037344-e680-4c70-9a79-ee60fd873016 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:24.326348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fe038139-d1db-454e-a3ad-5329f2774270 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:24.328006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fe038139-d1db-454e-a3ad-5329f2774270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:24.354297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290f33-3273-4fd2-918f-306141cf2b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:24.355500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290f33-3273-4fd2-918f-306141cf2b07 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.356052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290f33-3273-4fd2-918f-306141cf2b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.357045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290f33-3273-4fd2-918f-306141cf2b07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.367986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25290f33-3273-4fd2-918f-306141cf2b07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:24.370171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25290f33-3273-4fd2-918f-306141cf2b07 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-25290f33-3273-4fd2-918f-306141cf2b07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:24.392388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:24.393349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:24.394273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:24.394273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:24.394273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:24.394273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:24.394273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:24.394273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:24.394273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:24.394273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:24.394273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 413/831] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:24.399865 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290f33-3273-4fd2-918f-306141cf2b07 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.413234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 419/832] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:24.442949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe038139-d1db-454e-a3ad-5329f2774270 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.516149 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:24.546108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290f33-3273-4fd2-918f-306141cf2b07 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:24.554240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe038139-d1db-454e-a3ad-5329f2774270 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:24.589489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ca339-3da9-4692-b260-06697688ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:24.590724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca339-3da9-4692-b260-06697688ea90 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.592491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca339-3da9-4692-b260-06697688ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.592950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca339-3da9-4692-b260-06697688ea90 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.593097 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2144c-aee2-4e2e-87e8-3c2f842561e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:24.593905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2144c-aee2-4e2e-87e8-3c2f842561e5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.594253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2144c-aee2-4e2e-87e8-3c2f842561e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.594506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ca339-3da9-4692-b260-06697688ea90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:24.594624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2144c-aee2-4e2e-87e8-3c2f842561e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.595168 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ca339-3da9-4692-b260-06697688ea90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:24.596986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ca339-3da9-4692-b260-06697688ea90 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:24.605928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2144c-aee2-4e2e-87e8-3c2f842561e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3ba2144c-aee2-4e2e-87e8-3c2f842561e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:24.614263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:24.615757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:24.617164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 420/833] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:24.627780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 414/834] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:24.628522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2144c-aee2-4e2e-87e8-3c2f842561e5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.636121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ca339-3da9-4692-b260-06697688ea90 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.641849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:24.743897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2144c-aee2-4e2e-87e8-3c2f842561e5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:24.764651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ca339-3da9-4692-b260-06697688ea90 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:24.772490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:24.783172 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5870f57-c229-4337-ad13-801bf0c245a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:24.783779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5870f57-c229-4337-ad13-801bf0c245a3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.784069 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5870f57-c229-4337-ad13-801bf0c245a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.784346 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5870f57-c229-4337-ad13-801bf0c245a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.785276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5870f57-c229-4337-ad13-801bf0c245a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:24.785592 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5870f57-c229-4337-ad13-801bf0c245a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:24.787099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5870f57-c229-4337-ad13-801bf0c245a3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:24.801315 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 421/835] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:24.802380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5870f57-c229-4337-ad13-801bf0c245a3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.811127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185b05-fdaa-4a76-8438-d6ab85e51c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:24.812151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185b05-fdaa-4a76-8438-d6ab85e51c1f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.812625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185b05-fdaa-4a76-8438-d6ab85e51c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.813132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185b05-fdaa-4a76-8438-d6ab85e51c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.814284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d185b05-fdaa-4a76-8438-d6ab85e51c1f None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=f2faa046b0294a0ba1090be84bb1cebc) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:24.814799 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d185b05-fdaa-4a76-8438-d6ab85e51c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:24.816503 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d185b05-fdaa-4a76-8438-d6ab85e51c1f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:24.830310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 415/836] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/role_assignments?user.id=f2faa046b0294a0ba1090be84bb1cebc&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:24.916493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5870f57-c229-4337-ad13-801bf0c245a3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:24.956115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca966c1-425e-43a1-b566-0b74f551c368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:24.956931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca966c1-425e-43a1-b566-0b74f551c368 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.957218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca966c1-425e-43a1-b566-0b74f551c368 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.957498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca966c1-425e-43a1-b566-0b74f551c368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.970738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca966c1-425e-43a1-b566-0b74f551c368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:24.972223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca966c1-425e-43a1-b566-0b74f551c368 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-aca966c1-425e-43a1-b566-0b74f551c368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:24.992568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:24.993508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:24.994397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:24.994397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:24.994397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:24.994397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:24.994397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 422/837] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:25.000847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185b05-fdaa-4a76-8438-d6ab85e51c1f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.080295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.122996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185b05-fdaa-4a76-8438-d6ab85e51c1f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.151375 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef21b22-947a-4e7e-9595-a3d1c969522b None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.151729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef21b22-947a-4e7e-9595-a3d1c969522b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.151928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef21b22-947a-4e7e-9595-a3d1c969522b None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.153515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 423/838] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:25.161413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8efc7f-1cf7-4c80-889c-6e9fd358e6b5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.162031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8efc7f-1cf7-4c80-889c-6e9fd358e6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.162555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8efc7f-1cf7-4c80-889c-6e9fd358e6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.163313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec6b1b-e494-4af3-9346-fca0cdc8fc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.163984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec6b1b-e494-4af3-9346-fca0cdc8fc53 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.164263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec6b1b-e494-4af3-9346-fca0cdc8fc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.164537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec6b1b-e494-4af3-9346-fca0cdc8fc53 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.165257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec6b1b-e494-4af3-9346-fca0cdc8fc53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:25.165559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec6b1b-e494-4af3-9346-fca0cdc8fc53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:25.167226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec6b1b-e494-4af3-9346-fca0cdc8fc53 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:25.181876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 416/839] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:25.187394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec6b1b-e494-4af3-9346-fca0cdc8fc53 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.188884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fb8efc7f-1cf7-4c80-889c-6e9fd358e6b5 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:25.190544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fb8efc7f-1cf7-4c80-889c-6e9fd358e6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:25.239594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.289119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 424/840] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:25.305832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec6b1b-e494-4af3-9346-fca0cdc8fc53 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.312853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8efc7f-1cf7-4c80-889c-6e9fd358e6b5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.334295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.343875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab70f7-46a0-4dd1-8df8-35388276c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.344930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab70f7-46a0-4dd1-8df8-35388276c44d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.345356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab70f7-46a0-4dd1-8df8-35388276c44d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.345766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab70f7-46a0-4dd1-8df8-35388276c44d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.353497 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab70f7-46a0-4dd1-8df8-35388276c44d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:25.355161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab70f7-46a0-4dd1-8df8-35388276c44d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-9eab70f7-46a0-4dd1-8df8-35388276c44d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:25.371001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:25.372769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:25.374202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:25.374202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:25.374202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:25.374202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:25.374202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:25.374202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:25.374202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:25.374202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:25.374202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:25.374202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:25.380896 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 417/841] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:25.382088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab70f7-46a0-4dd1-8df8-35388276c44d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.426369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8efc7f-1cf7-4c80-889c-6e9fd358e6b5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.467920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ec539-8ee2-4b55-9bfc-a9158f908bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.469157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec539-8ee2-4b55-9bfc-a9158f908bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.469407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec539-8ee2-4b55-9bfc-a9158f908bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.469785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec539-8ee2-4b55-9bfc-a9158f908bb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.483982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ec539-8ee2-4b55-9bfc-a9158f908bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f38ec539-8ee2-4b55-9bfc-a9158f908bb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:25.492815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:25.493996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:25.494822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:25.496342 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab70f7-46a0-4dd1-8df8-35388276c44d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.500438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 425/842] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:25.502124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ec539-8ee2-4b55-9bfc-a9158f908bb2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.539502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.544108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fb72b-9f92-4e2f-b023-2c6c90e3a5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.546418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fb72b-9f92-4e2f-b023-2c6c90e3a5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.546418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fb72b-9f92-4e2f-b023-2c6c90e3a5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.546418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fb72b-9f92-4e2f-b023-2c6c90e3a5b4 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.546920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fb72b-9f92-4e2f-b023-2c6c90e3a5b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:25.547247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fb72b-9f92-4e2f-b023-2c6c90e3a5b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:25.548630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fb72b-9f92-4e2f-b023-2c6c90e3a5b4 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:25.566870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 418/843] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:25.571527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd226c-eb3e-41ff-84eb-5b3184783817 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.571978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd226c-eb3e-41ff-84eb-5b3184783817 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.572259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd226c-eb3e-41ff-84eb-5b3184783817 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.574094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 419/844] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:25.574670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd226c-eb3e-41ff-84eb-5b3184783817 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.620176 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ec539-8ee2-4b55-9bfc-a9158f908bb2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.626806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.663597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448d3f8-eceb-4070-a9b7-b9dea4762c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.664567 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d3f8-eceb-4070-a9b7-b9dea4762c15 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.664849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d3f8-eceb-4070-a9b7-b9dea4762c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.665126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d3f8-eceb-4070-a9b7-b9dea4762c15 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.666157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448d3f8-eceb-4070-a9b7-b9dea4762c15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:25.666924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448d3f8-eceb-4070-a9b7-b9dea4762c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:25.668528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448d3f8-eceb-4070-a9b7-b9dea4762c15 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:25.679522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 426/845] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:25.680705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3ce5-1234-4159-9cf5-f91deb685e91 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.680992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3ce5-1234-4159-9cf5-f91deb685e91 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.681269 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3ce5-1234-4159-9cf5-f91deb685e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.692401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd226c-eb3e-41ff-84eb-5b3184783817 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.699046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5e2c3ce5-1234-4159-9cf5-f91deb685e91 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:25.700223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5e2c3ce5-1234-4159-9cf5-f91deb685e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:25.735897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfcbc8-0d20-4996-8ace-113c0cf6ceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.736558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfcbc8-0d20-4996-8ace-113c0cf6ceea None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.736843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfcbc8-0d20-4996-8ace-113c0cf6ceea None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.737120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfcbc8-0d20-4996-8ace-113c0cf6ceea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.782071 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 427/846] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:25.782071 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c3ce5-1234-4159-9cf5-f91deb685e91 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.808944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.817266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfcbc8-0d20-4996-8ace-113c0cf6ceea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:25.818944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfcbc8-0d20-4996-8ace-113c0cf6ceea None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:25.864632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.891320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c3ce5-1234-4159-9cf5-f91deb685e91 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.930012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 420/847] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:42:25.930012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfcbc8-0d20-4996-8ace-113c0cf6ceea None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.935365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d0bd6-ee7e-485f-a637-9e06bfbe37e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.936253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d0bd6-ee7e-485f-a637-9e06bfbe37e8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.936529 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d0bd6-ee7e-485f-a637-9e06bfbe37e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.936794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d0bd6-ee7e-485f-a637-9e06bfbe37e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.948587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d0bd6-ee7e-485f-a637-9e06bfbe37e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:25.950072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d0bd6-ee7e-485f-a637-9e06bfbe37e8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3d4d0bd6-ee7e-485f-a637-9e06bfbe37e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:25.968019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:25.969000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:25.970145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:25.970145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:25.970145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:25.970145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:25.973922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 428/848] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:25.974806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d0bd6-ee7e-485f-a637-9e06bfbe37e8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.037943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfcbc8-0d20-4996-8ace-113c0cf6ceea None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.056202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:26.078601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b0e01-d2e0-4890-abda-7044518f7bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.079431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b0e01-d2e0-4890-abda-7044518f7bcf None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.079705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b0e01-d2e0-4890-abda-7044518f7bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.080010 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b0e01-d2e0-4890-abda-7044518f7bcf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.080644 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b0e01-d2e0-4890-abda-7044518f7bcf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.082122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b0e01-d2e0-4890-abda-7044518f7bcf None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.088831 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d0bd6-ee7e-485f-a637-9e06bfbe37e8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-fc8b0e01-d2e0-4890-abda-7044518f7bcf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:26.096878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:26.097928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:26.098768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 421/849] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:26.099554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b0e01-d2e0-4890-abda-7044518f7bcf None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.117093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:26.129798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c30cc-2bce-4bd5-8e46-5a999bd8f8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.131275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c30cc-2bce-4bd5-8e46-5a999bd8f8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.131275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c30cc-2bce-4bd5-8e46-5a999bd8f8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.131275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c30cc-2bce-4bd5-8e46-5a999bd8f8b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.144046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c30cc-2bce-4bd5-8e46-5a999bd8f8b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.145894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c30cc-2bce-4bd5-8e46-5a999bd8f8b3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b64c30cc-2bce-4bd5-8e46-5a999bd8f8b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:26.163981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:26.164917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:26.166736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:26.166736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:26.166736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:26.166736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:26.166736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 429/850] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:26.166736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c30cc-2bce-4bd5-8e46-5a999bd8f8b3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.222742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b0e01-d2e0-4890-abda-7044518f7bcf None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.258555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e501d9-0e39-4517-9753-d68a7797434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.259224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e501d9-0e39-4517-9753-d68a7797434c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.259509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e501d9-0e39-4517-9753-d68a7797434c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.259790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e501d9-0e39-4517-9753-d68a7797434c None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.260504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e501d9-0e39-4517-9753-d68a7797434c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:26.260810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e501d9-0e39-4517-9753-d68a7797434c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.262202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e501d9-0e39-4517-9753-d68a7797434c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.280295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 422/851] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:26.280295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e501d9-0e39-4517-9753-d68a7797434c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.280564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c30cc-2bce-4bd5-8e46-5a999bd8f8b3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.304714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:26.316120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49961fb5-c6e7-4cd7-985c-848ec48ca46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.316599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49961fb5-c6e7-4cd7-985c-848ec48ca46a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.316883 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49961fb5-c6e7-4cd7-985c-848ec48ca46a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.317152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49961fb5-c6e7-4cd7-985c-848ec48ca46a None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.317859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49961fb5-c6e7-4cd7-985c-848ec48ca46a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:26.318198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49961fb5-c6e7-4cd7-985c-848ec48ca46a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.319557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49961fb5-c6e7-4cd7-985c-848ec48ca46a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.329659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 430/852] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:26.329659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49961fb5-c6e7-4cd7-985c-848ec48ca46a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.359667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:26.396915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e501d9-0e39-4517-9753-d68a7797434c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.430249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2be991-c027-4706-a127-4eec50e74850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.430912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2be991-c027-4706-a127-4eec50e74850 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.431192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2be991-c027-4706-a127-4eec50e74850 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.431463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2be991-c027-4706-a127-4eec50e74850 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.432169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2be991-c027-4706-a127-4eec50e74850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:26.432466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2be991-c027-4706-a127-4eec50e74850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.433812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2be991-c027-4706-a127-4eec50e74850 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.437278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49961fb5-c6e7-4cd7-985c-848ec48ca46a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.445568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 423/853] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:26.451463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2be991-c027-4706-a127-4eec50e74850 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.474841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398523b-668d-435f-a850-ee59c82385d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.475855 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398523b-668d-435f-a850-ee59c82385d9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.476328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398523b-668d-435f-a850-ee59c82385d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.476801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398523b-668d-435f-a850-ee59c82385d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.485641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398523b-668d-435f-a850-ee59c82385d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.487546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398523b-668d-435f-a850-ee59c82385d9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d398523b-668d-435f-a850-ee59c82385d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:26.503972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:26.505114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:26.506284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:26.506284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:26.506284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:26.506284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:26.506284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:26.506284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:26.506284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:26.506284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:26.506284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:42:26.506284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:26.508359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 431/854] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:26.509484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398523b-668d-435f-a850-ee59c82385d9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.559014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2be991-c027-4706-a127-4eec50e74850 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.565759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:26.589420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:26.598871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67d201-081b-4213-9bd3-c266cb8ad909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.599665 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d201-081b-4213-9bd3-c266cb8ad909 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.599946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d201-081b-4213-9bd3-c266cb8ad909 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.600221 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d201-081b-4213-9bd3-c266cb8ad909 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.600930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67d201-081b-4213-9bd3-c266cb8ad909 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:26.601236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67d201-081b-4213-9bd3-c266cb8ad909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.602858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67d201-081b-4213-9bd3-c266cb8ad909 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.617914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 424/855] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:26.617914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67d201-081b-4213-9bd3-c266cb8ad909 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.631199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398523b-668d-435f-a850-ee59c82385d9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.690524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4b62d-71a6-4a7f-add0-4c84e5d45972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.691881 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4b62d-71a6-4a7f-add0-4c84e5d45972 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.692309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4b62d-71a6-4a7f-add0-4c84e5d45972 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.693009 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4b62d-71a6-4a7f-add0-4c84e5d45972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.703873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4b62d-71a6-4a7f-add0-4c84e5d45972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.706186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4b62d-71a6-4a7f-add0-4c84e5d45972 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-29c4b62d-71a6-4a7f-add0-4c84e5d45972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:26.727140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:26.728217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:26.729295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:26.729295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:26.729295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:26.729295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:26.729295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:26.729295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:26.729295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:26.729295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:26.737422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 432/856] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:26.738946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4b62d-71a6-4a7f-add0-4c84e5d45972 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.775141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67d201-081b-4213-9bd3-c266cb8ad909 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.826417 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735615ac-23e0-4f7d-ac43-e0527511e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.827464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735615ac-23e0-4f7d-ac43-e0527511e630 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.828103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735615ac-23e0-4f7d-ac43-e0527511e630 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.828575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735615ac-23e0-4f7d-ac43-e0527511e630 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.829624 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735615ac-23e0-4f7d-ac43-e0527511e630 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:26.830203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735615ac-23e0-4f7d-ac43-e0527511e630 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.831844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735615ac-23e0-4f7d-ac43-e0527511e630 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.851549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 425/857] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:26.857717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735615ac-23e0-4f7d-ac43-e0527511e630 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.874617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4b62d-71a6-4a7f-add0-4c84e5d45972 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.886440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:26.914053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f867-af05-477a-8fc5-3c53c2bb6343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.915071 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f867-af05-477a-8fc5-3c53c2bb6343 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.915559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f867-af05-477a-8fc5-3c53c2bb6343 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.916036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f867-af05-477a-8fc5-3c53c2bb6343 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.917012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:26.917606 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18f867-af05-477a-8fc5-3c53c2bb6343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:26.918149 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18f867-af05-477a-8fc5-3c53c2bb6343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.920070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18f867-af05-477a-8fc5-3c53c2bb6343 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.933812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 433/858] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:26.946854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f867-af05-477a-8fc5-3c53c2bb6343 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.978271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735615ac-23e0-4f7d-ac43-e0527511e630 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.016789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045100d0-23c2-4828-a93c-c1127106e638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.017450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045100d0-23c2-4828-a93c-c1127106e638 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.017797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045100d0-23c2-4828-a93c-c1127106e638 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.018177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045100d0-23c2-4828-a93c-c1127106e638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.076231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f867-af05-477a-8fc5-3c53c2bb6343 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.095407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045100d0-23c2-4828-a93c-c1127106e638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:27.096988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045100d0-23c2-4828-a93c-c1127106e638 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:27.126139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd160e2-4edf-4d11-aa48-c2a2b947c6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.127078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd160e2-4edf-4d11-aa48-c2a2b947c6df None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.127363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd160e2-4edf-4d11-aa48-c2a2b947c6df None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.127660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd160e2-4edf-4d11-aa48-c2a2b947c6df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.129254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd160e2-4edf-4d11-aa48-c2a2b947c6df None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=7255df373d794cf8b2548b3c0876dd22) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:27.129571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd160e2-4edf-4d11-aa48-c2a2b947c6df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:27.131811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd160e2-4edf-4d11-aa48-c2a2b947c6df None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:27.146081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 434/859] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/role_assignments?user.id=7255df373d794cf8b2548b3c0876dd22&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:27.175566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.181429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c42e3c-616f-4c02-ba4f-43dfc25740c9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.181739 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c42e3c-616f-4c02-ba4f-43dfc25740c9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.182025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c42e3c-616f-4c02-ba4f-43dfc25740c9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.183989 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 435/860] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:27.189915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82e2bc-19c7-4c00-91d2-79634407c7ae None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.190217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82e2bc-19c7-4c00-91d2-79634407c7ae None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.190466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82e2bc-19c7-4c00-91d2-79634407c7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.208948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8b82e2bc-19c7-4c00-91d2-79634407c7ae None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:27.210196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8b82e2bc-19c7-4c00-91d2-79634407c7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:27.227749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 426/861] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:42:27.229076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045100d0-23c2-4828-a93c-c1127106e638 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.242463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.292038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 436/862] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:27.316894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82e2bc-19c7-4c00-91d2-79634407c7ae None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.368795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045100d0-23c2-4828-a93c-c1127106e638 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.410584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854d1b-9b4b-4c9a-9e0e-a8140333ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.411390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854d1b-9b4b-4c9a-9e0e-a8140333ea94 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.411667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854d1b-9b4b-4c9a-9e0e-a8140333ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.411946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854d1b-9b4b-4c9a-9e0e-a8140333ea94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.425081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97854d1b-9b4b-4c9a-9e0e-a8140333ea94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:27.427077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97854d1b-9b4b-4c9a-9e0e-a8140333ea94 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:27.451611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82e2bc-19c7-4c00-91d2-79634407c7ae None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-97854d1b-9b4b-4c9a-9e0e-a8140333ea94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:27.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:27.456995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:27.457923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:27.457923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:27.457923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:27.457923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:27.457923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 427/863] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:27.465638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854d1b-9b4b-4c9a-9e0e-a8140333ea94 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.469471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.495301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244c1ca-47bf-4780-8705-9bd2b532e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.496051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244c1ca-47bf-4780-8705-9bd2b532e32a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.496330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244c1ca-47bf-4780-8705-9bd2b532e32a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.496885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244c1ca-47bf-4780-8705-9bd2b532e32a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.497941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244c1ca-47bf-4780-8705-9bd2b532e32a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:27.499451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244c1ca-47bf-4780-8705-9bd2b532e32a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-9244c1ca-47bf-4780-8705-9bd2b532e32a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:27.516117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:27.517091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:42:27.517976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:27.521982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 437/864] 10.222.0.81 () {56 vars in 1132 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:27.524699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244c1ca-47bf-4780-8705-9bd2b532e32a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.562372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.604923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854d1b-9b4b-4c9a-9e0e-a8140333ea94 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.652958 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244c1ca-47bf-4780-8705-9bd2b532e32a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.661532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0161807-abfd-46d2-bb33-7d30b6635996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.662533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0161807-abfd-46d2-bb33-7d30b6635996 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.663010 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0161807-abfd-46d2-bb33-7d30b6635996 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.663463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0161807-abfd-46d2-bb33-7d30b6635996 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.664899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0161807-abfd-46d2-bb33-7d30b6635996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:27.665416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0161807-abfd-46d2-bb33-7d30b6635996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:27.667091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0161807-abfd-46d2-bb33-7d30b6635996 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:27.680881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 428/865] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:27.686029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0161807-abfd-46d2-bb33-7d30b6635996 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.706599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7e57e-c388-45b6-b5c1-de99366e8de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.708124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7e57e-c388-45b6-b5c1-de99366e8de4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.708862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7e57e-c388-45b6-b5c1-de99366e8de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.709330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7e57e-c388-45b6-b5c1-de99366e8de4 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.710502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7e57e-c388-45b6-b5c1-de99366e8de4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:27.711439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7e57e-c388-45b6-b5c1-de99366e8de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:27.713103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7e57e-c388-45b6-b5c1-de99366e8de4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:27.722038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 438/866] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:27.729143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7e57e-c388-45b6-b5c1-de99366e8de4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.787094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.822699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0161807-abfd-46d2-bb33-7d30b6635996 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.850304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.854417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7e57e-c388-45b6-b5c1-de99366e8de4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.870042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482383a5-f08b-41f0-9993-7b82bc1a48ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.871097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482383a5-f08b-41f0-9993-7b82bc1a48ed None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.871382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482383a5-f08b-41f0-9993-7b82bc1a48ed None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.871659 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482383a5-f08b-41f0-9993-7b82bc1a48ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.882033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482383a5-f08b-41f0-9993-7b82bc1a48ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:27.884209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482383a5-f08b-41f0-9993-7b82bc1a48ed None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:27.894752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690821b2-88a6-4b54-92ee-f8e0580912da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.895789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690821b2-88a6-4b54-92ee-f8e0580912da None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.896273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690821b2-88a6-4b54-92ee-f8e0580912da None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.896790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690821b2-88a6-4b54-92ee-f8e0580912da None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.897785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690821b2-88a6-4b54-92ee-f8e0580912da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:27.898317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690821b2-88a6-4b54-92ee-f8e0580912da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:27.899920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690821b2-88a6-4b54-92ee-f8e0580912da None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-482383a5-f08b-41f0-9993-7b82bc1a48ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:27.901984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:27.902917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:27.904745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:27.904745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:27.904745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:27.904745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:27.904745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:27.904745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:27.904745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:27.904745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:27.906022 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 429/867] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:27.909961 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482383a5-f08b-41f0-9993-7b82bc1a48ed None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.912068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 439/868] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:28.033177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482383a5-f08b-41f0-9993-7b82bc1a48ed None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:28.060944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:28.076078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ac8a1-3d62-48db-9b34-5ac6da962961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.077020 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ac8a1-3d62-48db-9b34-5ac6da962961 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.077463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ac8a1-3d62-48db-9b34-5ac6da962961 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.077911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ac8a1-3d62-48db-9b34-5ac6da962961 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.078949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ac8a1-3d62-48db-9b34-5ac6da962961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:28.079265 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ac8a1-3d62-48db-9b34-5ac6da962961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:28.081102 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ac8a1-3d62-48db-9b34-5ac6da962961 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:28.096901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 430/869] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:28.102542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690821b2-88a6-4b54-92ee-f8e0580912da None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:28.209762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690821b2-88a6-4b54-92ee-f8e0580912da None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:28.246142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a32b13-a031-4ea6-be60-501111f724b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.246807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a32b13-a031-4ea6-be60-501111f724b6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.247113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a32b13-a031-4ea6-be60-501111f724b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.247438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a32b13-a031-4ea6-be60-501111f724b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.248322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a32b13-a031-4ea6-be60-501111f724b6 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=c0e6fc45641f4c279def2d4aa971978d) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:28.248635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a32b13-a031-4ea6-be60-501111f724b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:28.250102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a32b13-a031-4ea6-be60-501111f724b6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:28.256858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 440/870] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:28 2022] GET /identity/v3/role_assignments?user.id=c0e6fc45641f4c279def2d4aa971978d&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:28.823242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54ab4a-3a56-47c9-b73c-2f68537e9dac None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.823587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54ab4a-3a56-47c9-b73c-2f68537e9dac None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.823796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54ab4a-3a56-47c9-b73c-2f68537e9dac None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.826003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 431/871] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:28.831370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452a3c-2c12-4f87-8d99-f673091ef959 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.831827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452a3c-2c12-4f87-8d99-f673091ef959 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.832014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452a3c-2c12-4f87-8d99-f673091ef959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.849201 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a7452a3c-2c12-4f87-8d99-f673091ef959 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:28.850705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a7452a3c-2c12-4f87-8d99-f673091ef959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:28.865792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:28.919418 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 441/872] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:28.941843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54ab4a-3a56-47c9-b73c-2f68537e9dac None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.048992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54ab4a-3a56-47c9-b73c-2f68537e9dac None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.085182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b7583-1c65-4c10-a74b-4bca17a35ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.085911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7583-1c65-4c10-a74b-4bca17a35ed8 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.086196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7583-1c65-4c10-a74b-4bca17a35ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.086469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7583-1c65-4c10-a74b-4bca17a35ed8 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.087224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b7583-1c65-4c10-a74b-4bca17a35ed8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:29.088628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b7583-1c65-4c10-a74b-4bca17a35ed8 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:29.103899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 432/873] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:28 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:29.629739 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc1702-dfc7-4d2f-bc42-64f98b785caf None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.630163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc1702-dfc7-4d2f-bc42-64f98b785caf None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.630355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc1702-dfc7-4d2f-bc42-64f98b785caf None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.631944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 442/874] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:29.637139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d808fff-17cb-4508-9611-f02c8c836544 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.638408 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d808fff-17cb-4508-9611-f02c8c836544 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.639169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d808fff-17cb-4508-9611-f02c8c836544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.657334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-8d808fff-17cb-4508-9611-f02c8c836544 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:29.658664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8d808fff-17cb-4508-9611-f02c8c836544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:29.695748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:29.738841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 433/875] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:29.762481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc1702-dfc7-4d2f-bc42-64f98b785caf None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.876075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc1702-dfc7-4d2f-bc42-64f98b785caf None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.913538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd312b-6b83-469f-a71f-93b4071a1bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.914310 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd312b-6b83-469f-a71f-93b4071a1bde None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.914618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd312b-6b83-469f-a71f-93b4071a1bde None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.914919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd312b-6b83-469f-a71f-93b4071a1bde None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.926616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd312b-6b83-469f-a71f-93b4071a1bde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-48bd312b-6b83-469f-a71f-93b4071a1bde None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:29.935794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:29.936710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:29.938372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 443/876] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Jun 16 14:42:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:29.942881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d808fff-17cb-4508-9611-f02c8c836544 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.043514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d808fff-17cb-4508-9611-f02c8c836544 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:30.078073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40568-19d4-47f0-9d03-af740094ad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:30.078744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40568-19d4-47f0-9d03-af740094ad08 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.079021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40568-19d4-47f0-9d03-af740094ad08 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.079288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40568-19d4-47f0-9d03-af740094ad08 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.080021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40568-19d4-47f0-9d03-af740094ad08 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:30.080317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40568-19d4-47f0-9d03-af740094ad08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.081673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40568-19d4-47f0-9d03-af740094ad08 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.090127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 434/877] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Jun 16 14:42:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:30.096456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd312b-6b83-469f-a71f-93b4071a1bde None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.110437 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:30.209990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd312b-6b83-469f-a71f-93b4071a1bde None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:30.218428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff41d-2faa-4d32-8975-91dcaa3f45cb None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.218946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff41d-2faa-4d32-8975-91dcaa3f45cb None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.219064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff41d-2faa-4d32-8975-91dcaa3f45cb None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.221722 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 435/878] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:30.225794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3971f-6431-421e-8d39-3672ebdeb06c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.226104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3971f-6431-421e-8d39-3672ebdeb06c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.226375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3971f-6431-421e-8d39-3672ebdeb06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.244336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-21c3971f-6431-421e-8d39-3672ebdeb06c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:30.245507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-21c3971f-6431-421e-8d39-3672ebdeb06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:30.250177 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff48e4-47b8-4a62-ad2a-c11b1c1d2bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:30.251575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff48e4-47b8-4a62-ad2a-c11b1c1d2bad None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.252028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff48e4-47b8-4a62-ad2a-c11b1c1d2bad None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.252456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff48e4-47b8-4a62-ad2a-c11b1c1d2bad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.266160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff48e4-47b8-4a62-ad2a-c11b1c1d2bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.267931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff48e4-47b8-4a62-ad2a-c11b1c1d2bad None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.274018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-fcff48e4-47b8-4a62-ad2a-c11b1c1d2bad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:30.288974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:30.290166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:30.291239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:30.291239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:30.291239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:30.291239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:30.293081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 444/879] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:30.301958 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff48e4-47b8-4a62-ad2a-c11b1c1d2bad None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.326190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 436/880] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:30.350595 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3971f-6431-421e-8d39-3672ebdeb06c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.375528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:30.420099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff48e4-47b8-4a62-ad2a-c11b1c1d2bad None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:30.461538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba5281-825f-4bad-b731-d73fd2dc5b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:30.462188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba5281-825f-4bad-b731-d73fd2dc5b2f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.462466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba5281-825f-4bad-b731-d73fd2dc5b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.462740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba5281-825f-4bad-b731-d73fd2dc5b2f None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.463467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba5281-825f-4bad-b731-d73fd2dc5b2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:30.463873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba5281-825f-4bad-b731-d73fd2dc5b2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.465378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba5281-825f-4bad-b731-d73fd2dc5b2f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.479665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 445/881] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:30.485931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba5281-825f-4bad-b731-d73fd2dc5b2f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.487788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3971f-6431-421e-8d39-3672ebdeb06c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:30.549143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb7df1-81c3-4daf-876b-8a5b27397d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:30.549821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb7df1-81c3-4daf-876b-8a5b27397d6d None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.550130 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb7df1-81c3-4daf-876b-8a5b27397d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.550404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb7df1-81c3-4daf-876b-8a5b27397d6d None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.551127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb7df1-81c3-4daf-876b-8a5b27397d6d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.552634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb7df1-81c3-4daf-876b-8a5b27397d6d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.568536 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 437/882] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:30 2022] POST /identity/v3/services => generated 269 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:30.570086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1022564-ed12-4f12-b4d1-1e45cfb7d421 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.570374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1022564-ed12-4f12-b4d1-1e45cfb7d421 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.570675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1022564-ed12-4f12-b4d1-1e45cfb7d421 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.572117 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 438/883] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:30.578616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2b21-d11f-41ef-8850-28694744b52b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.578902 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2b21-d11f-41ef-8850-28694744b52b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.579177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2b21-d11f-41ef-8850-28694744b52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.598660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c05e2b21-d11f-41ef-8850-28694744b52b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:30.599901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c05e2b21-d11f-41ef-8850-28694744b52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:30.616077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba5281-825f-4bad-b731-d73fd2dc5b2f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:30.618002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:30.650926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:30.677231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ed1c-af66-47b8-97dd-e5fa1339d601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:30.678707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ed1c-af66-47b8-97dd-e5fa1339d601 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.679715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ed1c-af66-47b8-97dd-e5fa1339d601 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.680506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ed1c-af66-47b8-97dd-e5fa1339d601 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.692177 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92ed1c-af66-47b8-97dd-e5fa1339d601 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.694013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92ed1c-af66-47b8-97dd-e5fa1339d601 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.698566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 439/884] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-0f92ed1c-af66-47b8-97dd-e5fa1339d601 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:30.711727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:30.712763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:30.713756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:30.713756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:30.713756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:30.713756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:30.713756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:30.713756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:30.713756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:30.713756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:30.713756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:30.713756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:30.716988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 446/885] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Jun 16 14:42:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:30.722083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e2b21-d11f-41ef-8850-28694744b52b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.723377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ed1c-af66-47b8-97dd-e5fa1339d601 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.852584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e2b21-d11f-41ef-8850-28694744b52b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:30.862977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ed1c-af66-47b8-97dd-e5fa1339d601 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:30.894927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60573ba-aead-49d1-9cf9-7c59e3a066c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:30.896117 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60573ba-aead-49d1-9cf9-7c59e3a066c8 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.896716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60573ba-aead-49d1-9cf9-7c59e3a066c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.897323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60573ba-aead-49d1-9cf9-7c59e3a066c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.898366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60573ba-aead-49d1-9cf9-7c59e3a066c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.900073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60573ba-aead-49d1-9cf9-7c59e3a066c8 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.909156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649fbc-2ac2-4fb9-aa74-5ab129dfe5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:30.909839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649fbc-2ac2-4fb9-aa74-5ab129dfe5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.910142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649fbc-2ac2-4fb9-aa74-5ab129dfe5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.910417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649fbc-2ac2-4fb9-aa74-5ab129dfe5c4 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.911255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b649fbc-2ac2-4fb9-aa74-5ab129dfe5c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:30.911562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b649fbc-2ac2-4fb9-aa74-5ab129dfe5c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.912974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b649fbc-2ac2-4fb9-aa74-5ab129dfe5c4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-d60573ba-aead-49d1-9cf9-7c59e3a066c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:30.915817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:30.916786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:30.917621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:30.921247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 440/886] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Jun 16 14:42:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:30.927393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60573ba-aead-49d1-9cf9-7c59e3a066c8 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.933033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 447/887] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Jun 16 14:42:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:30.938855 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649fbc-2ac2-4fb9-aa74-5ab129dfe5c4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.946263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:30.982058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:31.043638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60573ba-aead-49d1-9cf9-7c59e3a066c8 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:31.056243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649fbc-2ac2-4fb9-aa74-5ab129dfe5c4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:31.082340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8411a-3c6e-41e7-911b-8607803a522c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:31.083468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8411a-3c6e-41e7-911b-8607803a522c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.084112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8411a-3c6e-41e7-911b-8607803a522c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.084623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8411a-3c6e-41e7-911b-8607803a522c None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.085638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8411a-3c6e-41e7-911b-8607803a522c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:31.086261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8411a-3c6e-41e7-911b-8607803a522c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:31.087823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8411a-3c6e-41e7-911b-8607803a522c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:31.098317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d5368-33e4-4e02-ae24-9a1c1eb483fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:31.098317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d5368-33e4-4e02-ae24-9a1c1eb483fc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.098317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d5368-33e4-4e02-ae24-9a1c1eb483fc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.098317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d5368-33e4-4e02-ae24-9a1c1eb483fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.098987 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 441/888] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Jun 16 14:42:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:31.100134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8411a-3c6e-41e7-911b-8607803a522c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:31.176834 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d5368-33e4-4e02-ae24-9a1c1eb483fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:31.178696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d5368-33e4-4e02-ae24-9a1c1eb483fc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:31.205978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:31.217432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:31.235953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8411a-3c6e-41e7-911b-8607803a522c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:31.285160 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216002f8-b159-414d-b5ec-b45f2ed6b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:31.286091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216002f8-b159-414d-b5ec-b45f2ed6b88f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.286391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216002f8-b159-414d-b5ec-b45f2ed6b88f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.286670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216002f8-b159-414d-b5ec-b45f2ed6b88f None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.287803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216002f8-b159-414d-b5ec-b45f2ed6b88f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:31.288121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216002f8-b159-414d-b5ec-b45f2ed6b88f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:31.289759 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216002f8-b159-414d-b5ec-b45f2ed6b88f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:31.296027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 448/889] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:30 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:42:31.305971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 442/890] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Jun 16 14:42:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:31.311125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d5368-33e4-4e02-ae24-9a1c1eb483fc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:31.385155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c371a2-29e1-4da4-a897-3a38939326c3 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.385530 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c371a2-29e1-4da4-a897-3a38939326c3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.385711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c371a2-29e1-4da4-a897-3a38939326c3 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.387743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 443/891] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:31.393566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8b806-6ff6-4b46-aca6-6918ac4eaac5 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.394283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8b806-6ff6-4b46-aca6-6918ac4eaac5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.394767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8b806-6ff6-4b46-aca6-6918ac4eaac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.413843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-90c8b806-6ff6-4b46-aca6-6918ac4eaac5 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:31.415580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-90c8b806-6ff6-4b46-aca6-6918ac4eaac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:31.442703 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d5368-33e4-4e02-ae24-9a1c1eb483fc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:31.493369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1db25b-ad5d-46d0-bbbe-beb7648a0229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:31.493369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1db25b-ad5d-46d0-bbbe-beb7648a0229 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.493369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1db25b-ad5d-46d0-bbbe-beb7648a0229 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.493724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1db25b-ad5d-46d0-bbbe-beb7648a0229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.499174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:31.509459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 444/892] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:42:31.510024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1db25b-ad5d-46d0-bbbe-beb7648a0229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:31.511551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1db25b-ad5d-46d0-bbbe-beb7648a0229 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-2e1db25b-ad5d-46d0-bbbe-beb7648a0229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:31.533922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:31.534894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:31.535895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:31.535895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:31.535895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:31.535895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:31.535895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 449/893] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:31.537112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8b806-6ff6-4b46-aca6-6918ac4eaac5 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:31.540639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1db25b-ad5d-46d0-bbbe-beb7648a0229 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:31.631196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:31.665981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1db25b-ad5d-46d0-bbbe-beb7648a0229 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:31.674219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8b806-6ff6-4b46-aca6-6918ac4eaac5 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:31.705131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535de2-f0a1-4ae1-8daf-1368bad158c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:31.706389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535de2-f0a1-4ae1-8daf-1368bad158c2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.706891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535de2-f0a1-4ae1-8daf-1368bad158c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.707379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535de2-f0a1-4ae1-8daf-1368bad158c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.708396 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28535de2-f0a1-4ae1-8daf-1368bad158c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:31.709107 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28535de2-f0a1-4ae1-8daf-1368bad158c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:31.710869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28535de2-f0a1-4ae1-8daf-1368bad158c2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:31.718216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819d206-2a1b-4ff5-857d-2e1bd71ebef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:31.719016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819d206-2a1b-4ff5-857d-2e1bd71ebef5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.719292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819d206-2a1b-4ff5-857d-2e1bd71ebef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.719560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819d206-2a1b-4ff5-857d-2e1bd71ebef5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.720775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819d206-2a1b-4ff5-857d-2e1bd71ebef5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:31.722157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819d206-2a1b-4ff5-857d-2e1bd71ebef5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:31.726584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 450/894] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:31.731688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535de2-f0a1-4ae1-8daf-1368bad158c2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-b819d206-2a1b-4ff5-857d-2e1bd71ebef5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:31.742016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:31.743050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:42:31.743924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:31.749223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 445/895] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:31.750167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819d206-2a1b-4ff5-857d-2e1bd71ebef5 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:31.813836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:31.877326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535de2-f0a1-4ae1-8daf-1368bad158c2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:31.884408 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819d206-2a1b-4ff5-857d-2e1bd71ebef5 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:31.913646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a577b1-721a-48af-be99-5b247ec7e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:31.915038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a577b1-721a-48af-be99-5b247ec7e97c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.915462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a577b1-721a-48af-be99-5b247ec7e97c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.915921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a577b1-721a-48af-be99-5b247ec7e97c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.923921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a577b1-721a-48af-be99-5b247ec7e97c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:31.925359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a577b1-721a-48af-be99-5b247ec7e97c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:31.928887 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6e69c-0fc9-4f86-8287-16e6fcd3ce17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:31.929561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6e69c-0fc9-4f86-8287-16e6fcd3ce17 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.929845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6e69c-0fc9-4f86-8287-16e6fcd3ce17 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.930224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6e69c-0fc9-4f86-8287-16e6fcd3ce17 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.930930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6e69c-0fc9-4f86-8287-16e6fcd3ce17 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:31.931240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6e69c-0fc9-4f86-8287-16e6fcd3ce17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:31.932589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6e69c-0fc9-4f86-8287-16e6fcd3ce17 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:31.934597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:31.939853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 446/896] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:31.949502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6e69c-0fc9-4f86-8287-16e6fcd3ce17 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d3a577b1-721a-48af-be99-5b247ec7e97c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:31.955963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:31.957087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:31.958192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:31.958192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:31.958192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:31.958192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:31.958192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:31.958192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:31.958192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:31.958192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:31.960419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 451/897] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:31.969933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a577b1-721a-48af-be99-5b247ec7e97c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:32.076891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6e69c-0fc9-4f86-8287-16e6fcd3ce17 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:32.091903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a577b1-721a-48af-be99-5b247ec7e97c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:32.101767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:32.116632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db2a34-a5c7-4595-adb7-aded56a36025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:32.117646 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db2a34-a5c7-4595-adb7-aded56a36025 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.118140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db2a34-a5c7-4595-adb7-aded56a36025 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.118666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db2a34-a5c7-4595-adb7-aded56a36025 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.119507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db2a34-a5c7-4595-adb7-aded56a36025 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:32.119952 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db2a34-a5c7-4595-adb7-aded56a36025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:32.121671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db2a34-a5c7-4595-adb7-aded56a36025 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:32.128223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 447/898] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:32.133821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db2a34-a5c7-4595-adb7-aded56a36025 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:32.134946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a1bfe-750a-41c0-9eef-be2868b5ab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:32.135776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1bfe-750a-41c0-9eef-be2868b5ab5e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.136066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1bfe-750a-41c0-9eef-be2868b5ab5e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.136391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1bfe-750a-41c0-9eef-be2868b5ab5e None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.137703 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a1bfe-750a-41c0-9eef-be2868b5ab5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:32.137830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a1bfe-750a-41c0-9eef-be2868b5ab5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:32.139651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a1bfe-750a-41c0-9eef-be2868b5ab5e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:32.157623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 452/899] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:32.158837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a1bfe-750a-41c0-9eef-be2868b5ab5e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:32.209867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:32.252643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db2a34-a5c7-4595-adb7-aded56a36025 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:32.267654 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a1bfe-750a-41c0-9eef-be2868b5ab5e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:32.291959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459c329-0ce2-4055-95c6-361d1c884955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:32.293065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c329-0ce2-4055-95c6-361d1c884955 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.293521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c329-0ce2-4055-95c6-361d1c884955 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.294125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c329-0ce2-4055-95c6-361d1c884955 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.295538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459c329-0ce2-4055-95c6-361d1c884955 None admin] RBAC: Adding query filter params (interface=public, service_id=1859baa9278d4008840574bd130577db, region_id=RegionOne) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:32.296097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459c329-0ce2-4055-95c6-361d1c884955 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:32.297679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459c329-0ce2-4055-95c6-361d1c884955 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:32.303793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 448/900] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Jun 16 14:42:32 2022] GET /identity/v3/endpoints?service_id=1859baa9278d4008840574bd130577db&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:32.306601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6261d79-e78b-43de-a9e8-076621ae4110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:32.307426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261d79-e78b-43de-a9e8-076621ae4110 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.307848 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261d79-e78b-43de-a9e8-076621ae4110 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.308428 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261d79-e78b-43de-a9e8-076621ae4110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.309264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6261d79-e78b-43de-a9e8-076621ae4110 None admin] RBAC: Adding query filter params (role.id=c88603395e0444799ae7807bcb6a3ffe, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=7255df373d794cf8b2548b3c0876dd22) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:32.310295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6261d79-e78b-43de-a9e8-076621ae4110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:32.311973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6261d79-e78b-43de-a9e8-076621ae4110 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:32.314746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459c329-0ce2-4055-95c6-361d1c884955 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:32.326011 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 453/901] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:32 2022] GET /identity/v3/role_assignments?user.id=7255df373d794cf8b2548b3c0876dd22&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=c88603395e0444799ae7807bcb6a3ffe => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:32.432686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459c329-0ce2-4055-95c6-361d1c884955 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:32.464422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:32.475688 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794461de-7319-4cf3-98aa-cc96a3ff9895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:32.476378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794461de-7319-4cf3-98aa-cc96a3ff9895 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.476667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794461de-7319-4cf3-98aa-cc96a3ff9895 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.476942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794461de-7319-4cf3-98aa-cc96a3ff9895 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.477637 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794461de-7319-4cf3-98aa-cc96a3ff9895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:32.479070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794461de-7319-4cf3-98aa-cc96a3ff9895 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:32.486009 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 449/902] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Jun 16 14:42:32 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:42:32.904916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d7bbd-c79e-4116-98c5-4433cb97adb4 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.905310 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d7bbd-c79e-4116-98c5-4433cb97adb4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.905604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d7bbd-c79e-4116-98c5-4433cb97adb4 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.907543 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 454/903] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:32.913084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ce10b-ee71-45b1-a865-4d4f30ba83ae None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.913381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ce10b-ee71-45b1-a865-4d4f30ba83ae None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.913663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ce10b-ee71-45b1-a865-4d4f30ba83ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.930688 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-e85ce10b-ee71-45b1-a865-4d4f30ba83ae None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:32.931874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e85ce10b-ee71-45b1-a865-4d4f30ba83ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:33.004030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 450/904] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:33.024728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d7bbd-c79e-4116-98c5-4433cb97adb4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.057794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:33.135188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d7bbd-c79e-4116-98c5-4433cb97adb4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.173959 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a00862-9710-49b7-8224-8b9771aa2277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.174715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a00862-9710-49b7-8224-8b9771aa2277 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.174996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a00862-9710-49b7-8224-8b9771aa2277 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.175270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a00862-9710-49b7-8224-8b9771aa2277 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.175977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a00862-9710-49b7-8224-8b9771aa2277 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:33.177349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a00862-9710-49b7-8224-8b9771aa2277 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b8a00862-9710-49b7-8224-8b9771aa2277 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:33.190787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:33.191794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:33.192627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 455/905] 10.222.0.81 () {56 vars in 1132 bytes} [Thu Jun 16 14:42:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:33.198270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ce10b-ee71-45b1-a865-4d4f30ba83ae None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.303383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ce10b-ee71-45b1-a865-4d4f30ba83ae None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.328016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:33.340076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eb4d4-aacb-4d8f-b387-51af26542960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.340802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb4d4-aacb-4d8f-b387-51af26542960 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.341081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb4d4-aacb-4d8f-b387-51af26542960 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.341351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb4d4-aacb-4d8f-b387-51af26542960 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.342082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eb4d4-aacb-4d8f-b387-51af26542960 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:33.342385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eb4d4-aacb-4d8f-b387-51af26542960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:33.343751 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eb4d4-aacb-4d8f-b387-51af26542960 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:33.348990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 451/906] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Jun 16 14:42:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:33.354456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a00862-9710-49b7-8224-8b9771aa2277 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.455724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:33.462673 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a00862-9710-49b7-8224-8b9771aa2277 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.502237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a542bc-a667-4fa5-b8f7-8243d7124657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.503188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a542bc-a667-4fa5-b8f7-8243d7124657 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.503622 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a542bc-a667-4fa5-b8f7-8243d7124657 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.504073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a542bc-a667-4fa5-b8f7-8243d7124657 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.504971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a542bc-a667-4fa5-b8f7-8243d7124657 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:33.505438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a542bc-a667-4fa5-b8f7-8243d7124657 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:33.507055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a542bc-a667-4fa5-b8f7-8243d7124657 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:33.514413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 456/907] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Jun 16 14:42:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:33.525934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eb4d4-aacb-4d8f-b387-51af26542960 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.575599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a24f7-408a-4b11-a33e-bf3f90f9bafa None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.576139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a24f7-408a-4b11-a33e-bf3f90f9bafa None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.576651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a24f7-408a-4b11-a33e-bf3f90f9bafa None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.578524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 457/908] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:33.584340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2af00-fdb8-413c-9ae9-9ccac4b11471 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.584633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2af00-fdb8-413c-9ae9-9ccac4b11471 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.584946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2af00-fdb8-413c-9ae9-9ccac4b11471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.604899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-bee2af00-fdb8-413c-9ae9-9ccac4b11471 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:33.607291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bee2af00-fdb8-413c-9ae9-9ccac4b11471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:33.643445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eb4d4-aacb-4d8f-b387-51af26542960 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.691784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11893-34a5-4b5f-b938-cdc82456304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.692960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11893-34a5-4b5f-b938-cdc82456304c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.693446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11893-34a5-4b5f-b938-cdc82456304c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.693988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11893-34a5-4b5f-b938-cdc82456304c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.695110 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11893-34a5-4b5f-b938-cdc82456304c None admin] RBAC: Adding query filter params (interface=public, service_id=94007c00ea4d4e67a813e6974d1900d2, region_id=RegionOne) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:33.695625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11893-34a5-4b5f-b938-cdc82456304c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:33.697197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11893-34a5-4b5f-b938-cdc82456304c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:33.698199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 458/909] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:42:33.708391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 452/910] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Jun 16 14:42:33 2022] GET /identity/v3/endpoints?service_id=94007c00ea4d4e67a813e6974d1900d2&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:33.710033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2af00-fdb8-413c-9ae9-9ccac4b11471 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.718095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11893-34a5-4b5f-b938-cdc82456304c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.773076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:33.817942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:33.828958 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2af00-fdb8-413c-9ae9-9ccac4b11471 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.831449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11893-34a5-4b5f-b938-cdc82456304c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.866958 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcc4d6-08e3-41d0-a62a-3f9efffbb1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.867627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcc4d6-08e3-41d0-a62a-3f9efffbb1cf None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.867914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcc4d6-08e3-41d0-a62a-3f9efffbb1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.868196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcc4d6-08e3-41d0-a62a-3f9efffbb1cf None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.868984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcc4d6-08e3-41d0-a62a-3f9efffbb1cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:33.869566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9890b-f3a2-4e39-92b1-f1761c0ddb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.870482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9890b-f3a2-4e39-92b1-f1761c0ddb55 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.870589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcc4d6-08e3-41d0-a62a-3f9efffbb1cf None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:33.871055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9890b-f3a2-4e39-92b1-f1761c0ddb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.871619 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9890b-f3a2-4e39-92b1-f1761c0ddb55 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.873266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9890b-f3a2-4e39-92b1-f1761c0ddb55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:33.874849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9890b-f3a2-4e39-92b1-f1761c0ddb55 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:33.877351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 459/911] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Jun 16 14:42:33 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:42:33.891570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 453/912] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:33 2022] POST /identity/v3/services => generated 241 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:42:34.633204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42493911-ed70-48a6-81bc-2c4094da8ba7 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.633722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42493911-ed70-48a6-81bc-2c4094da8ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.633834 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42493911-ed70-48a6-81bc-2c4094da8ba7 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.635377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 460/913] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:34.641385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984378eb-fca9-4fc6-8c25-515aaac6d31e None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.641863 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984378eb-fca9-4fc6-8c25-515aaac6d31e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.641968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984378eb-fca9-4fc6-8c25-515aaac6d31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.671628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-984378eb-fca9-4fc6-8c25-515aaac6d31e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:34.672896 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-984378eb-fca9-4fc6-8c25-515aaac6d31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:34.752257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 454/914] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:34.759665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f99f43-b2b6-4345-a00d-ec7926ce3871 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.759957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f99f43-b2b6-4345-a00d-ec7926ce3871 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.760239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f99f43-b2b6-4345-a00d-ec7926ce3871 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.761826 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 461/915] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:34.768512 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8e0f-412e-47ec-97e2-2522990624ee None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.769012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8e0f-412e-47ec-97e2-2522990624ee None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.769484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8e0f-412e-47ec-97e2-2522990624ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.780249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f99f43-b2b6-4345-a00d-ec7926ce3871 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:34.787391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-785d8e0f-412e-47ec-97e2-2522990624ee None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:34.788789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-785d8e0f-412e-47ec-97e2-2522990624ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:34.820339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:34.864803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 455/916] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:34.888540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d8e0f-412e-47ec-97e2-2522990624ee None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:34.894995 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f99f43-b2b6-4345-a00d-ec7926ce3871 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:34.941927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11127e2-9a57-4f65-8b5a-59c10dc16b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:34.942751 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11127e2-9a57-4f65-8b5a-59c10dc16b2f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.943032 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11127e2-9a57-4f65-8b5a-59c10dc16b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.943307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11127e2-9a57-4f65-8b5a-59c10dc16b2f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.958027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11127e2-9a57-4f65-8b5a-59c10dc16b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-e11127e2-9a57-4f65-8b5a-59c10dc16b2f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:34.968669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:34.969611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:42:34.970454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:34.973916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 462/917] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:34.976993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11127e2-9a57-4f65-8b5a-59c10dc16b2f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:34.997173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:35.007105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d8e0f-412e-47ec-97e2-2522990624ee None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.046762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaf512-58c3-462f-b541-3b7f2188f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.047933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaf512-58c3-462f-b541-3b7f2188f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.048398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaf512-58c3-462f-b541-3b7f2188f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.048822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaf512-58c3-462f-b541-3b7f2188f9a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.049629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaf512-58c3-462f-b541-3b7f2188f9a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.051345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaf512-58c3-462f-b541-3b7f2188f9a7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-5ceaf512-58c3-462f-b541-3b7f2188f9a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:35.065224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:35.066558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:42:35.067615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:35.070527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 456/918] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:35.076873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaf512-58c3-462f-b541-3b7f2188f9a7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:35.095723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11127e2-9a57-4f65-8b5a-59c10dc16b2f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.119492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:35.140317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692658a-0943-4449-be6a-bdb5b77ab729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.141261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692658a-0943-4449-be6a-bdb5b77ab729 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.141646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692658a-0943-4449-be6a-bdb5b77ab729 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.142361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692658a-0943-4449-be6a-bdb5b77ab729 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.143433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692658a-0943-4449-be6a-bdb5b77ab729 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:35.143746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692658a-0943-4449-be6a-bdb5b77ab729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.145582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692658a-0943-4449-be6a-bdb5b77ab729 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.157480 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 463/919] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:35.162900 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692658a-0943-4449-be6a-bdb5b77ab729 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:35.218608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaf512-58c3-462f-b541-3b7f2188f9a7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.246731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:35.265428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf7482-13b3-43ff-931d-fb0e8c8276cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.266224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf7482-13b3-43ff-931d-fb0e8c8276cf None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.266854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf7482-13b3-43ff-931d-fb0e8c8276cf None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.267143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf7482-13b3-43ff-931d-fb0e8c8276cf None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.267893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf7482-13b3-43ff-931d-fb0e8c8276cf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:35.268205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf7482-13b3-43ff-931d-fb0e8c8276cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.270175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf7482-13b3-43ff-931d-fb0e8c8276cf None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.275717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692658a-0943-4449-be6a-bdb5b77ab729 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.276796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 457/920] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:35.282858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf7482-13b3-43ff-931d-fb0e8c8276cf None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:35.318559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0e852-6034-4848-a363-947db039a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.319658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0e852-6034-4848-a363-947db039a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.320120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0e852-6034-4848-a363-947db039a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.320599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0e852-6034-4848-a363-947db039a2a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.332271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0e852-6034-4848-a363-947db039a2a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.333999 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0e852-6034-4848-a363-947db039a2a8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-70b0e852-6034-4848-a363-947db039a2a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:35.352400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:35.353313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:35.354264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:35.354264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:35.354264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:35.354264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:35.361267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 464/921] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:35.362698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0e852-6034-4848-a363-947db039a2a8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:35.385694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:35.395274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf7482-13b3-43ff-931d-fb0e8c8276cf None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.431539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf5fb9-b6c7-45e1-a957-8ae5d0fb7cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.432603 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5fb9-b6c7-45e1-a957-8ae5d0fb7cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.433044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5fb9-b6c7-45e1-a957-8ae5d0fb7cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.433468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5fb9-b6c7-45e1-a957-8ae5d0fb7cb3 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.434936 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf5fb9-b6c7-45e1-a957-8ae5d0fb7cb3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:35.435426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf5fb9-b6c7-45e1-a957-8ae5d0fb7cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.437050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf5fb9-b6c7-45e1-a957-8ae5d0fb7cb3 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.443115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 458/922] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:35.454067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf5fb9-b6c7-45e1-a957-8ae5d0fb7cb3 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:35.473495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0e852-6034-4848-a363-947db039a2a8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.509338 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:35.523028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e80f3-4740-4773-85fc-850c5dcd96d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.524222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e80f3-4740-4773-85fc-850c5dcd96d9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.524658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e80f3-4740-4773-85fc-850c5dcd96d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.525274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e80f3-4740-4773-85fc-850c5dcd96d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.526926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e80f3-4740-4773-85fc-850c5dcd96d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:35.527516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e80f3-4740-4773-85fc-850c5dcd96d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.530155 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e80f3-4740-4773-85fc-850c5dcd96d9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.550905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 465/923] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:35.553019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e80f3-4740-4773-85fc-850c5dcd96d9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:35.581075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf5fb9-b6c7-45e1-a957-8ae5d0fb7cb3 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.634545 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae11c7-1f6a-4451-a67e-51ee8b3aa64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.635215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae11c7-1f6a-4451-a67e-51ee8b3aa64d None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.635496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae11c7-1f6a-4451-a67e-51ee8b3aa64d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.636021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae11c7-1f6a-4451-a67e-51ee8b3aa64d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.636765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae11c7-1f6a-4451-a67e-51ee8b3aa64d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.639524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae11c7-1f6a-4451-a67e-51ee8b3aa64d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.675361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 459/924] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Jun 16 14:42:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:35.696413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e80f3-4740-4773-85fc-850c5dcd96d9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.744344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aec83-1b86-4bb5-8cbc-5ece32eda8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.745602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aec83-1b86-4bb5-8cbc-5ece32eda8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.746145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aec83-1b86-4bb5-8cbc-5ece32eda8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.746628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aec83-1b86-4bb5-8cbc-5ece32eda8d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.755810 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aec83-1b86-4bb5-8cbc-5ece32eda8d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.757651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aec83-1b86-4bb5-8cbc-5ece32eda8d6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-fb3aec83-1b86-4bb5-8cbc-5ece32eda8d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:35.780528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:35.781633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:35.782603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:35.782603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:35.782603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:35.782603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:35.782603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:35.782603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:35.782603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:35.782603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:35.782603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:35.782603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:35.782603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 466/925] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Jun 16 14:42:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:35.790756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae11c7-1f6a-4451-a67e-51ee8b3aa64d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:35.810826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:35.911046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae11c7-1f6a-4451-a67e-51ee8b3aa64d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.946420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89a50c-5160-4314-8aa3-1147d4b04d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.947383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89a50c-5160-4314-8aa3-1147d4b04d7f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.947845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89a50c-5160-4314-8aa3-1147d4b04d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.948298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89a50c-5160-4314-8aa3-1147d4b04d7f None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.949306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89a50c-5160-4314-8aa3-1147d4b04d7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:35.949816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89a50c-5160-4314-8aa3-1147d4b04d7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.951490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89a50c-5160-4314-8aa3-1147d4b04d7f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.971112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 460/926] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Jun 16 14:42:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:35.976649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aec83-1b86-4bb5-8cbc-5ece32eda8d6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.026484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:36.083104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aec83-1b86-4bb5-8cbc-5ece32eda8d6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:36.125557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dc46c-8f01-479e-bee9-840e81ead976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:36.126417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc46c-8f01-479e-bee9-840e81ead976 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.126696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc46c-8f01-479e-bee9-840e81ead976 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.126971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc46c-8f01-479e-bee9-840e81ead976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.138926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dc46c-8f01-479e-bee9-840e81ead976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:36.140442 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dc46c-8f01-479e-bee9-840e81ead976 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-223dc46c-8f01-479e-bee9-840e81ead976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:36.160767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:36.161721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:36.163088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:36.163088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:36.163088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:36.163088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:36.163088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 467/927] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:36.170289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89a50c-5160-4314-8aa3-1147d4b04d7f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.175648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cec0dd-efc7-4a99-bc2b-9d08249d5b12 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.175954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cec0dd-efc7-4a99-bc2b-9d08249d5b12 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.176209 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cec0dd-efc7-4a99-bc2b-9d08249d5b12 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.177869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 468/928] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:36.183528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6bcb0-a2ca-492b-b001-88423017176e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.183817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6bcb0-a2ca-492b-b001-88423017176e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.184089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6bcb0-a2ca-492b-b001-88423017176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.202091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-abf6bcb0-a2ca-492b-b001-88423017176e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:36.203327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-abf6bcb0-a2ca-492b-b001-88423017176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:36.253134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:36.278950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 469/929] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:42:36.280728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4f1ed-37b9-4902-ac3b-7967333e1d36 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.281260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4f1ed-37b9-4902-ac3b-7967333e1d36 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.281736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4f1ed-37b9-4902-ac3b-7967333e1d36 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.283292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 470/930] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:36.288565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fe025-a7e0-4725-8b12-fd7a715363f7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.289743 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fe025-a7e0-4725-8b12-fd7a715363f7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.290249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fe025-a7e0-4725-8b12-fd7a715363f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.304341 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89a50c-5160-4314-8aa3-1147d4b04d7f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:36.310718 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f13fe025-a7e0-4725-8b12-fd7a715363f7 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:36.311926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f13fe025-a7e0-4725-8b12-fd7a715363f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:36.335952 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:36.344575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a3980-0735-4cf2-99bb-89c106ad5e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:36.345194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3980-0735-4cf2-99bb-89c106ad5e3e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.345537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3980-0735-4cf2-99bb-89c106ad5e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.345790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3980-0735-4cf2-99bb-89c106ad5e3e None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.346496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a3980-0735-4cf2-99bb-89c106ad5e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:36.346801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a3980-0735-4cf2-99bb-89c106ad5e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:36.348180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a3980-0735-4cf2-99bb-89c106ad5e3e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:36.364820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 461/931] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:36.364820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a3980-0735-4cf2-99bb-89c106ad5e3e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.391420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 471/932] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:36.392373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fe025-a7e0-4725-8b12-fd7a715363f7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.488981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a3980-0735-4cf2-99bb-89c106ad5e3e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:36.499629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fe025-a7e0-4725-8b12-fd7a715363f7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:36.520006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:36.526307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bf84f-9045-427c-96fc-a1e2cf4ab1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:36.527148 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf84f-9045-427c-96fc-a1e2cf4ab1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.527436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf84f-9045-427c-96fc-a1e2cf4ab1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.527711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf84f-9045-427c-96fc-a1e2cf4ab1b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.528519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bf84f-9045-427c-96fc-a1e2cf4ab1b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:36.529911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bf84f-9045-427c-96fc-a1e2cf4ab1b9 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:36.537177 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9b1ce-fb80-47d0-bdec-3d6e78f45d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:36.537998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9b1ce-fb80-47d0-bdec-3d6e78f45d0b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.538276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9b1ce-fb80-47d0-bdec-3d6e78f45d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.538545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9b1ce-fb80-47d0-bdec-3d6e78f45d0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-9d7bf84f-9045-427c-96fc-a1e2cf4ab1b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:36.542657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:36.544182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:36.545081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 462/933] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:36.546876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bf84f-9045-427c-96fc-a1e2cf4ab1b9 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.548528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9b1ce-fb80-47d0-bdec-3d6e78f45d0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:36.550308 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9b1ce-fb80-47d0-bdec-3d6e78f45d0b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f0d9b1ce-fb80-47d0-bdec-3d6e78f45d0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:36.565142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:36.566304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:36.567886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:36.567886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:36.567886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:36.567886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:36.567886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:36.567886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:36.567886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:36.567886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:36.571117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 472/934] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:36.571777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9b1ce-fb80-47d0-bdec-3d6e78f45d0b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.592581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:36.669281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bf84f-9045-427c-96fc-a1e2cf4ab1b9 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:36.682353 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9b1ce-fb80-47d0-bdec-3d6e78f45d0b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:36.711844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685b071-fa6e-45e1-8da0-7c2e56c8f0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:36.712660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685b071-fa6e-45e1-8da0-7c2e56c8f0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.712949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685b071-fa6e-45e1-8da0-7c2e56c8f0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.713227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685b071-fa6e-45e1-8da0-7c2e56c8f0f7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.713876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685b071-fa6e-45e1-8da0-7c2e56c8f0f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:36.715281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685b071-fa6e-45e1-8da0-7c2e56c8f0f7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:36.718878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c367ffa-074a-4b4f-b07e-4cc98e624be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:36.720036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c367ffa-074a-4b4f-b07e-4cc98e624be3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.720491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c367ffa-074a-4b4f-b07e-4cc98e624be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.720955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c367ffa-074a-4b4f-b07e-4cc98e624be3 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.721824 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c367ffa-074a-4b4f-b07e-4cc98e624be3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:36.722367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c367ffa-074a-4b4f-b07e-4cc98e624be3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:36.723877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c367ffa-074a-4b4f-b07e-4cc98e624be3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-c685b071-fa6e-45e1-8da0-7c2e56c8f0f7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:36.728399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:36.729295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:36.730167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 463/935] 10.222.0.81 () {56 vars in 1132 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:36.730986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685b071-fa6e-45e1-8da0-7c2e56c8f0f7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.732149 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 473/936] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:36.735959 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c367ffa-074a-4b4f-b07e-4cc98e624be3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.804072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:36.825109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:36.850084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c367ffa-074a-4b4f-b07e-4cc98e624be3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:36.851493 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685b071-fa6e-45e1-8da0-7c2e56c8f0f7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:36.886921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c56cd1-dde5-4289-92ce-b3f4ca1c3d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:36.887894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56cd1-dde5-4289-92ce-b3f4ca1c3d25 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.888185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56cd1-dde5-4289-92ce-b3f4ca1c3d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.888437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56cd1-dde5-4289-92ce-b3f4ca1c3d25 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.888919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d16209-8cce-4acc-a19f-6b9a8131611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:36.889232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c56cd1-dde5-4289-92ce-b3f4ca1c3d25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:36.889542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c56cd1-dde5-4289-92ce-b3f4ca1c3d25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:36.890100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d16209-8cce-4acc-a19f-6b9a8131611e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.890527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d16209-8cce-4acc-a19f-6b9a8131611e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.890966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d16209-8cce-4acc-a19f-6b9a8131611e None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.891078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c56cd1-dde5-4289-92ce-b3f4ca1c3d25 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:36.891915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d16209-8cce-4acc-a19f-6b9a8131611e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:36.892372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d16209-8cce-4acc-a19f-6b9a8131611e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:36.894166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d16209-8cce-4acc-a19f-6b9a8131611e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:36.899649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 474/937] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:36.900702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d16209-8cce-4acc-a19f-6b9a8131611e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.908868 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 464/938] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:36.910028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c56cd1-dde5-4289-92ce-b3f4ca1c3d25 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:37.014670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d16209-8cce-4acc-a19f-6b9a8131611e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:37.023923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c56cd1-dde5-4289-92ce-b3f4ca1c3d25 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:37.046868 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:37.052151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b1654-dc86-4dad-8ffd-10c2f84c5efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:37.052857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b1654-dc86-4dad-8ffd-10c2f84c5efd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.053144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b1654-dc86-4dad-8ffd-10c2f84c5efd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.053411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b1654-dc86-4dad-8ffd-10c2f84c5efd None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.054217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b1654-dc86-4dad-8ffd-10c2f84c5efd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:37.054477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b1654-dc86-4dad-8ffd-10c2f84c5efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:37.055839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b1654-dc86-4dad-8ffd-10c2f84c5efd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:37.065714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 475/939] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:37.065714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b1654-dc86-4dad-8ffd-10c2f84c5efd None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:37.067283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d349c-a5e8-4fb6-aa9b-056006cd8b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:37.068050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d349c-a5e8-4fb6-aa9b-056006cd8b9a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.068339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d349c-a5e8-4fb6-aa9b-056006cd8b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.068612 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d349c-a5e8-4fb6-aa9b-056006cd8b9a None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.069314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d349c-a5e8-4fb6-aa9b-056006cd8b9a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:37.069618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d349c-a5e8-4fb6-aa9b-056006cd8b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:37.071034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d349c-a5e8-4fb6-aa9b-056006cd8b9a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:37.076797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:37.081808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 465/940] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:37.082962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d349c-a5e8-4fb6-aa9b-056006cd8b9a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:37.172448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b1654-dc86-4dad-8ffd-10c2f84c5efd None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:37.190575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d349c-a5e8-4fb6-aa9b-056006cd8b9a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:37.212360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7e238-ff0a-4514-92df-f5705d657ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:37.213341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7e238-ff0a-4514-92df-f5705d657ea1 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.213630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7e238-ff0a-4514-92df-f5705d657ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.213946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7e238-ff0a-4514-92df-f5705d657ea1 None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/7255df373d794cf8b2548b3c0876dd22/roles/c88603395e0444799ae7807bcb6a3ffe` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.216293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7e238-ff0a-4514-92df-f5705d657ea1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=7255df373d794cf8b2548b3c0876dd22, role_id=c88603395e0444799ae7807bcb6a3ffe)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:37.217728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7e238-ff0a-4514-92df-f5705d657ea1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:37.228425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca143a-0ef2-45f4-8d94-ff84c3731c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:37.229325 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca143a-0ef2-45f4-8d94-ff84c3731c3d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.229612 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca143a-0ef2-45f4-8d94-ff84c3731c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.229915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca143a-0ef2-45f4-8d94-ff84c3731c3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.230707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca143a-0ef2-45f4-8d94-ff84c3731c3d None admin] RBAC: Adding query filter params (interface=public, service_id=beac9e6da47b498e82f9d41debebad7a, region_id=RegionOne) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:37.231021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca143a-0ef2-45f4-8d94-ff84c3731c3d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:37.239318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 476/941] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:37 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/7255df373d794cf8b2548b3c0876dd22/roles/c88603395e0444799ae7807bcb6a3ffe => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:37.239318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7e238-ff0a-4514-92df-f5705d657ea1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:37.239618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca143a-0ef2-45f4-8d94-ff84c3731c3d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:37.239618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 466/942] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Jun 16 14:42:37 2022] GET /identity/v3/endpoints?service_id=beac9e6da47b498e82f9d41debebad7a&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:37.245117 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca143a-0ef2-45f4-8d94-ff84c3731c3d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:37.307599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:37.346468 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:37.371429 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca143a-0ef2-45f4-8d94-ff84c3731c3d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:37.396959 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7e238-ff0a-4514-92df-f5705d657ea1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:37.413737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4239c1-b439-481d-bfe5-573ca87c1236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:37.414608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4239c1-b439-481d-bfe5-573ca87c1236 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.414960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4239c1-b439-481d-bfe5-573ca87c1236 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.415330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4239c1-b439-481d-bfe5-573ca87c1236 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.416094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4239c1-b439-481d-bfe5-573ca87c1236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:37.417564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4239c1-b439-481d-bfe5-573ca87c1236 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:37.434194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 467/943] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Jun 16 14:42:37 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:42:37.451923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4df83-723e-4883-9041-5e5b033d7b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:37.452622 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4df83-723e-4883-9041-5e5b033d7b24 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.452905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4df83-723e-4883-9041-5e5b033d7b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.453181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4df83-723e-4883-9041-5e5b033d7b24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.454109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4df83-723e-4883-9041-5e5b033d7b24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:37.455414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4df83-723e-4883-9041-5e5b033d7b24 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:37.486102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 477/944] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Jun 16 14:42:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:37.971210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239520-0976-43d2-8a2f-59e94bb110ce None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.971747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239520-0976-43d2-8a2f-59e94bb110ce None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.971747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239520-0976-43d2-8a2f-59e94bb110ce None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.973350 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 468/945] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:37.978625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625310a-c16d-497f-8d4c-390e4c683378 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.979048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625310a-c16d-497f-8d4c-390e4c683378 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.979225 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625310a-c16d-497f-8d4c-390e4c683378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.996997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6625310a-c16d-497f-8d4c-390e4c683378 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:37.998479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6625310a-c16d-497f-8d4c-390e4c683378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:38.074556 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 478/946] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:38.098404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85239520-0976-43d2-8a2f-59e94bb110ce None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:38.209716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85239520-0976-43d2-8a2f-59e94bb110ce None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:38.224097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:38.246514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe4594-2379-402f-855c-f730f518cf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:38.248138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe4594-2379-402f-855c-f730f518cf9c None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.248516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe4594-2379-402f-855c-f730f518cf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.248797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe4594-2379-402f-855c-f730f518cf9c None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.249531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe4594-2379-402f-855c-f730f518cf9c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:38.250977 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe4594-2379-402f-855c-f730f518cf9c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:38.252340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: WARNING keystone.server.flask.common [None req-2cfe4594-2379-402f-855c-f730f518cf9c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 14:42:38.273191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.sql.core [None req-2cfe4594-2379-402f-855c-f730f518cf9c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 14:42:38.273191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 14:42:38.273191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [parameters: {'id': 'a88dd3efe65d4385841acb3565a1e8d4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 14:42:38.273191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80108) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-2cfe4594-2379-402f-855c-f730f518cf9c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a88dd3efe65d4385841acb3565a1e8d4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a88dd3efe65d4385841acb3565a1e8d4. Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:42:38.291283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application result.read() Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 14:42:38.292171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application yield resource Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise self.value Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application session.commit() Jun 16 14:42:38.293146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self.session.flush() Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application compat.raise_( Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:42:38.295019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 14:42:38.296807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application result.read() Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:42:38.300965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [parameters: {'id': 'a88dd3efe65d4385841acb3565a1e8d4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:38.302824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:38.303657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:38.306071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:38.306071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 14:42:38.306071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 14:42:38.306071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:38.306071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:38.306071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 14:42:38.306071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 14:42:38.306071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a88dd3efe65d4385841acb3565a1e8d4. Jun 16 14:42:38.306071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:38.306071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 469/947] 10.222.0.81 () {60 vars in 1140 bytes} [Thu Jun 16 14:42:38 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:38.307332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625310a-c16d-497f-8d4c-390e4c683378 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:38.382239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:38.427299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625310a-c16d-497f-8d4c-390e4c683378 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:38.462800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c9559-8ee5-41ab-9b8e-443353a4f52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:38.463624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9559-8ee5-41ab-9b8e-443353a4f52f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.463907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9559-8ee5-41ab-9b8e-443353a4f52f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.464185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9559-8ee5-41ab-9b8e-443353a4f52f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.473102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9559-8ee5-41ab-9b8e-443353a4f52f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:38.474668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9559-8ee5-41ab-9b8e-443353a4f52f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4e4c9559-8ee5-41ab-9b8e-443353a4f52f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:38.490234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:38.491154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:38.492075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:38.492075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:38.492075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:38.492075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:38.492075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:38.492075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:38.492075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:38.492075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:38.492075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 479/948] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:38.497958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe4594-2379-402f-855c-f730f518cf9c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:38.611521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe4594-2379-402f-855c-f730f518cf9c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:38.659169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8bb4d-235b-4590-a67a-b1be816ade1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:38.659604 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8bb4d-235b-4590-a67a-b1be816ade1b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.659893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8bb4d-235b-4590-a67a-b1be816ade1b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.660173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8bb4d-235b-4590-a67a-b1be816ade1b None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.660946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8bb4d-235b-4590-a67a-b1be816ade1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:38.661260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8bb4d-235b-4590-a67a-b1be816ade1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:38.665906 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8bb4d-235b-4590-a67a-b1be816ade1b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:38.684736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 470/949] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:39.568385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e28ac9-b7d7-4974-9ca7-32f610d6fc87 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.569405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e28ac9-b7d7-4974-9ca7-32f610d6fc87 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.569926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e28ac9-b7d7-4974-9ca7-32f610d6fc87 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.571781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 480/950] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:39.577929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc5240-ebe2-49c6-a088-19983be0cfc4 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.578748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc5240-ebe2-49c6-a088-19983be0cfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.579236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc5240-ebe2-49c6-a088-19983be0cfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.597424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-21fc5240-ebe2-49c6-a088-19983be0cfc4 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:39.599031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-21fc5240-ebe2-49c6-a088-19983be0cfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:39.628369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:39.682460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 471/951] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:39.689944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae37b41-8c21-4d2e-8afe-6f6bb45dbe83 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.690502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae37b41-8c21-4d2e-8afe-6f6bb45dbe83 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.691005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae37b41-8c21-4d2e-8afe-6f6bb45dbe83 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.693793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 481/952] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:39.698337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019454-9ab8-48b7-a6e9-70377d79386e None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.698855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019454-9ab8-48b7-a6e9-70377d79386e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.699363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019454-9ab8-48b7-a6e9-70377d79386e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.702795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ad108-df0d-44eb-a705-a9b141f09b77 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.703221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ad108-df0d-44eb-a705-a9b141f09b77 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.703633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ad108-df0d-44eb-a705-a9b141f09b77 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.710147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 482/953] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:39.711009 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ad108-df0d-44eb-a705-a9b141f09b77 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:39.720424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-38019454-9ab8-48b7-a6e9-70377d79386e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:39.721616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-38019454-9ab8-48b7-a6e9-70377d79386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:39.795394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 472/954] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:39.796864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5698326-8efb-479c-85e4-a779f7093c30 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.797256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5698326-8efb-479c-85e4-a779f7093c30 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.797630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5698326-8efb-479c-85e4-a779f7093c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.814734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a5698326-8efb-479c-85e4-a779f7093c30 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:39.816323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a5698326-8efb-479c-85e4-a779f7093c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:39.829925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ad108-df0d-44eb-a705-a9b141f09b77 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:39.841948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:39.869738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b50ae9-d418-4e4f-aa04-a2f98191929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:39.870597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b50ae9-d418-4e4f-aa04-a2f98191929d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.870884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b50ae9-d418-4e4f-aa04-a2f98191929d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.871163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b50ae9-d418-4e4f-aa04-a2f98191929d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.884119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b50ae9-d418-4e4f-aa04-a2f98191929d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-70b50ae9-d418-4e4f-aa04-a2f98191929d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:39.892809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:39.894143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 483/955] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Jun 16 14:42:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:39.895062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b50ae9-d418-4e4f-aa04-a2f98191929d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:39.900712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 473/956] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:39.901460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5698326-8efb-479c-85e4-a779f7093c30 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:39.928399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:40.017639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b50ae9-d418-4e4f-aa04-a2f98191929d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.029381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5698326-8efb-479c-85e4-a779f7093c30 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.054868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936be4cd-65ab-487b-9bbc-ce96127f1da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.055672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be4cd-65ab-487b-9bbc-ce96127f1da5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.055950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be4cd-65ab-487b-9bbc-ce96127f1da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.056245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be4cd-65ab-487b-9bbc-ce96127f1da5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.056857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936be4cd-65ab-487b-9bbc-ce96127f1da5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.058263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936be4cd-65ab-487b-9bbc-ce96127f1da5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.067809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e8c16-3c8b-485a-9099-15f7e60404c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.068478 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e8c16-3c8b-485a-9099-15f7e60404c0 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.068763 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e8c16-3c8b-485a-9099-15f7e60404c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.069182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e8c16-3c8b-485a-9099-15f7e60404c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.070217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e8c16-3c8b-485a-9099-15f7e60404c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:40.070571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e8c16-3c8b-485a-9099-15f7e60404c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.071933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e8c16-3c8b-485a-9099-15f7e60404c0 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-936be4cd-65ab-487b-9bbc-ce96127f1da5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:40.072928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:40.074016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:40.074909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 484/957] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Jun 16 14:42:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:40.076488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936be4cd-65ab-487b-9bbc-ce96127f1da5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.091902 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 474/958] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Jun 16 14:42:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:40.091902 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e8c16-3c8b-485a-9099-15f7e60404c0 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.111938 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:40.180456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:40.187002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936be4cd-65ab-487b-9bbc-ce96127f1da5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.202041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e8c16-3c8b-485a-9099-15f7e60404c0 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.223127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba8dd5-1e1b-4952-8695-558116e39aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.223937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba8dd5-1e1b-4952-8695-558116e39aaf None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.224218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba8dd5-1e1b-4952-8695-558116e39aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.224497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba8dd5-1e1b-4952-8695-558116e39aaf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.225150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba8dd5-1e1b-4952-8695-558116e39aaf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.226557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba8dd5-1e1b-4952-8695-558116e39aaf None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.238261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525b8a5-0a9a-4a55-a143-54c9f8af59fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b9ba8dd5-1e1b-4952-8695-558116e39aaf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:40.238879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:40.239923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:40.240748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 485/959] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:40.241571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba8dd5-1e1b-4952-8695-558116e39aaf None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.242171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525b8a5-0a9a-4a55-a143-54c9f8af59fc None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.242593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525b8a5-0a9a-4a55-a143-54c9f8af59fc None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.242894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525b8a5-0a9a-4a55-a143-54c9f8af59fc None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.243606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525b8a5-0a9a-4a55-a143-54c9f8af59fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:40.243914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525b8a5-0a9a-4a55-a143-54c9f8af59fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.245277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525b8a5-0a9a-4a55-a143-54c9f8af59fc None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.251603 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 475/960] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:40.252390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525b8a5-0a9a-4a55-a143-54c9f8af59fc None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.354926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:40.359934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba8dd5-1e1b-4952-8695-558116e39aaf None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.368328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525b8a5-0a9a-4a55-a143-54c9f8af59fc None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.399575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cd5d7-c16b-406a-8412-af6f7243d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.400706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cd5d7-c16b-406a-8412-af6f7243d498 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.401210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cd5d7-c16b-406a-8412-af6f7243d498 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.401558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cd5d7-c16b-406a-8412-af6f7243d498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.408885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b597a78-d246-4f5b-84d7-75b848d7915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.409561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b597a78-d246-4f5b-84d7-75b848d7915f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.409843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b597a78-d246-4f5b-84d7-75b848d7915f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.410151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b597a78-d246-4f5b-84d7-75b848d7915f None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.410859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b597a78-d246-4f5b-84d7-75b848d7915f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:40.411167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b597a78-d246-4f5b-84d7-75b848d7915f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.412542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b597a78-d246-4f5b-84d7-75b848d7915f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.414542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cd5d7-c16b-406a-8412-af6f7243d498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.416172 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cd5d7-c16b-406a-8412-af6f7243d498 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.417417 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 476/961] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:40.418236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b597a78-d246-4f5b-84d7-75b848d7915f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.432489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-de6cd5d7-c16b-406a-8412-af6f7243d498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:40.440798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:40.441716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:40.442667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:40.442667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:40.442667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:40.442667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:40.442667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 486/962] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:40.443825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cd5d7-c16b-406a-8412-af6f7243d498 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.547102 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b597a78-d246-4f5b-84d7-75b848d7915f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.555773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cd5d7-c16b-406a-8412-af6f7243d498 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.583752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87face2e-9213-4dbe-b89c-bf438488c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.584438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87face2e-9213-4dbe-b89c-bf438488c29b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.584722 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87face2e-9213-4dbe-b89c-bf438488c29b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.584990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87face2e-9213-4dbe-b89c-bf438488c29b None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.585698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87face2e-9213-4dbe-b89c-bf438488c29b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:40.586055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87face2e-9213-4dbe-b89c-bf438488c29b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.587426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87face2e-9213-4dbe-b89c-bf438488c29b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.590237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416057c-cd9d-41d9-be0a-caf99624ec0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.591502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416057c-cd9d-41d9-be0a-caf99624ec0a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.591794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416057c-cd9d-41d9-be0a-caf99624ec0a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.592049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416057c-cd9d-41d9-be0a-caf99624ec0a None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.592747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416057c-cd9d-41d9-be0a-caf99624ec0a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:40.593052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416057c-cd9d-41d9-be0a-caf99624ec0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.598910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 477/963] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:40.599048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416057c-cd9d-41d9-be0a-caf99624ec0a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.599128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87face2e-9213-4dbe-b89c-bf438488c29b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.606349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 487/964] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:40.606349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416057c-cd9d-41d9-be0a-caf99624ec0a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.630471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:40.695727 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:40.745742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87face2e-9213-4dbe-b89c-bf438488c29b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.748688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416057c-cd9d-41d9-be0a-caf99624ec0a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.790353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e93efe-a6d1-424a-b05e-d3de0c24c833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.791122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93efe-a6d1-424a-b05e-d3de0c24c833 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.791467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93efe-a6d1-424a-b05e-d3de0c24c833 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.791809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93efe-a6d1-424a-b05e-d3de0c24c833 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.792600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e93efe-a6d1-424a-b05e-d3de0c24c833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:40.792973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e93efe-a6d1-424a-b05e-d3de0c24c833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.795598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e93efe-a6d1-424a-b05e-d3de0c24c833 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.801033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4e454-10cf-4c2c-b729-e32a76b11136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.801995 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4e454-10cf-4c2c-b729-e32a76b11136 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.802459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4e454-10cf-4c2c-b729-e32a76b11136 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.802954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4e454-10cf-4c2c-b729-e32a76b11136 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.803877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4e454-10cf-4c2c-b729-e32a76b11136 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.806114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4e454-10cf-4c2c-b729-e32a76b11136 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.812524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 478/965] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:40.819672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e93efe-a6d1-424a-b05e-d3de0c24c833 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.828567 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 488/966] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Jun 16 14:42:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:40.938342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1342-4d27-47ee-9b0d-020238dceea9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.938849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1342-4d27-47ee-9b0d-020238dceea9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.939342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1342-4d27-47ee-9b0d-020238dceea9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.941486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 489/967] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:40.946892 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779906fc-ba85-4cbe-842c-8a262675ee29 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.947725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779906fc-ba85-4cbe-842c-8a262675ee29 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.948234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779906fc-ba85-4cbe-842c-8a262675ee29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.952183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e93efe-a6d1-424a-b05e-d3de0c24c833 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.969987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-779906fc-ba85-4cbe-842c-8a262675ee29 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:40.971371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-779906fc-ba85-4cbe-842c-8a262675ee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:40.987560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.000892 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d772a5-cc3f-4a1f-839a-af8aee64bce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.001977 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d772a5-cc3f-4a1f-839a-af8aee64bce2 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.002430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d772a5-cc3f-4a1f-839a-af8aee64bce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.002920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d772a5-cc3f-4a1f-839a-af8aee64bce2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.011628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d772a5-cc3f-4a1f-839a-af8aee64bce2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.015046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d772a5-cc3f-4a1f-839a-af8aee64bce2 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-16d772a5-cc3f-4a1f-839a-af8aee64bce2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:41.033481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:41.034554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:41.035490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:41.035490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:41.035490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:41.035490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:41.035490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:41.035490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:41.035490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:41.035490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:41.035490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:42:41.035490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:41.037495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 479/968] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:41.042952 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d772a5-cc3f-4a1f-839a-af8aee64bce2 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.052280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.069962 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 490/969] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:41.084375 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779906fc-ba85-4cbe-842c-8a262675ee29 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.163161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d772a5-cc3f-4a1f-839a-af8aee64bce2 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.187840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779906fc-ba85-4cbe-842c-8a262675ee29 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.203401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86498845-6c87-4641-a138-f3ad4a59d624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.204413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498845-6c87-4641-a138-f3ad4a59d624 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.204899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498845-6c87-4641-a138-f3ad4a59d624 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.205388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498845-6c87-4641-a138-f3ad4a59d624 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.206568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86498845-6c87-4641-a138-f3ad4a59d624 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:41.207080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86498845-6c87-4641-a138-f3ad4a59d624 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.208712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86498845-6c87-4641-a138-f3ad4a59d624 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.224173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc477293-1a06-43d8-a7a3-be3d1b653e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.224856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc477293-1a06-43d8-a7a3-be3d1b653e36 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.225141 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc477293-1a06-43d8-a7a3-be3d1b653e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.225418 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc477293-1a06-43d8-a7a3-be3d1b653e36 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.226166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc477293-1a06-43d8-a7a3-be3d1b653e36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.227605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc477293-1a06-43d8-a7a3-be3d1b653e36 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.228918 dv-cinder-837353-2-smb devstack@keystone.service[80109]: WARNING keystone.server.flask.common [None req-bc477293-1a06-43d8-a7a3-be3d1b653e36 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 14:42:41.231485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 480/970] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:41.241908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86498845-6c87-4641-a138-f3ad4a59d624 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.242094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.sql.core [None req-bc477293-1a06-43d8-a7a3-be3d1b653e36 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 14:42:41.242094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 14:42:41.242094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [parameters: {'user_id': '1028474356614eab8e8deeca34ffe295', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 14:42:41.242094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80109) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-bc477293-1a06-43d8-a7a3-be3d1b653e36 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application result.read() Jun 16 14:42:41.250825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:42:41.251715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application yield resource Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise self.value Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application session.commit() Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 14:42:41.253637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.session.flush() Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application compat.raise_( Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:42:41.254723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:42:41.255625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application result.read() Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:42:41.256528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [parameters: {'user_id': '1028474356614eab8e8deeca34ffe295', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:41.257348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 14:42:41.258776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 14:42:41.259980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 14:42:41.259980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 14:42:41.259980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 14:42:41.259980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 14:42:41.259980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 14:42:41.259980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:41.259980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 491/971] 10.222.0.81 () {60 vars in 1131 bytes} [Thu Jun 16 14:42:41 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:41.259980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc477293-1a06-43d8-a7a3-be3d1b653e36 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.302590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.329682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.369858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86498845-6c87-4641-a138-f3ad4a59d624 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.374284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc477293-1a06-43d8-a7a3-be3d1b653e36 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.410118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d9abd-9474-456e-a965-55437be1ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.410914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d9abd-9474-456e-a965-55437be1ae08 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.411295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d9abd-9474-456e-a965-55437be1ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.411654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d9abd-9474-456e-a965-55437be1ae08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.412619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb853-958d-4cb6-94b0-f4b1de854295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.413720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb853-958d-4cb6-94b0-f4b1de854295 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.414246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb853-958d-4cb6-94b0-f4b1de854295 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.414666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb853-958d-4cb6-94b0-f4b1de854295 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.423655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cb853-958d-4cb6-94b0-f4b1de854295 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.425583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cb853-958d-4cb6-94b0-f4b1de854295 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-1b0cb853-958d-4cb6-94b0-f4b1de854295 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:41.441017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:41.442212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:41.443382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:41.443382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:41.443382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:41.443382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:41.443382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:41.443382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:41.443382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:41.443382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:41.443382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:42:41.443382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:41.450451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 492/972] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:41.451573 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb853-958d-4cb6-94b0-f4b1de854295 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.490754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d9abd-9474-456e-a965-55437be1ae08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.492297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d9abd-9474-456e-a965-55437be1ae08 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.543259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.563288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb853-958d-4cb6-94b0-f4b1de854295 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.587880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.600980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cccc1-1609-4bcc-a039-cc5ac067e690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.601686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cccc1-1609-4bcc-a039-cc5ac067e690 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.601974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cccc1-1609-4bcc-a039-cc5ac067e690 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.602263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cccc1-1609-4bcc-a039-cc5ac067e690 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.603184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cccc1-1609-4bcc-a039-cc5ac067e690 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:41.603386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cccc1-1609-4bcc-a039-cc5ac067e690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.604836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cccc1-1609-4bcc-a039-cc5ac067e690 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.615767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 481/973] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:42:41.617291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d9abd-9474-456e-a965-55437be1ae08 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.655165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 493/974] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:41.743801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d9abd-9474-456e-a965-55437be1ae08 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.783498 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3befd-d9f9-47e2-8d15-a83df0403e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.784697 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3befd-d9f9-47e2-8d15-a83df0403e8e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.785177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3befd-d9f9-47e2-8d15-a83df0403e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.785664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3befd-d9f9-47e2-8d15-a83df0403e8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.798033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3befd-d9f9-47e2-8d15-a83df0403e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.799871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3befd-d9f9-47e2-8d15-a83df0403e8e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.807788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-5fa3befd-d9f9-47e2-8d15-a83df0403e8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:41.821089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:41.822029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:41.822916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:41.822916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:41.822916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:41.822916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:41.825647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 482/975] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:41.831518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cccc1-1609-4bcc-a039-cc5ac067e690 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.942452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cccc1-1609-4bcc-a039-cc5ac067e690 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.980884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b06e7-b144-41b2-a0fd-056210a042a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.981646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b06e7-b144-41b2-a0fd-056210a042a3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.982028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b06e7-b144-41b2-a0fd-056210a042a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.982316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b06e7-b144-41b2-a0fd-056210a042a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.983053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b06e7-b144-41b2-a0fd-056210a042a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:41.983357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b06e7-b144-41b2-a0fd-056210a042a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.984828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b06e7-b144-41b2-a0fd-056210a042a3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.997652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 494/976] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:42.003241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3befd-d9f9-47e2-8d15-a83df0403e8e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:42.112296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3befd-d9f9-47e2-8d15-a83df0403e8e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:42.147332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c54894-0cad-4fbf-b3f8-5751ed67951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:42.148138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c54894-0cad-4fbf-b3f8-5751ed67951f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.148416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c54894-0cad-4fbf-b3f8-5751ed67951f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.148693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c54894-0cad-4fbf-b3f8-5751ed67951f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.156940 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c54894-0cad-4fbf-b3f8-5751ed67951f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:42.158536 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c54894-0cad-4fbf-b3f8-5751ed67951f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-c6c54894-0cad-4fbf-b3f8-5751ed67951f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:42.173323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:42.174547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:42.175430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:42.175430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:42.175430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:42.175430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:42.175430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:42.175430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:42.175430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:42.175430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:42.175430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 483/977] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:42.181822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b06e7-b144-41b2-a0fd-056210a042a3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:42.226352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:42.288096 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b06e7-b144-41b2-a0fd-056210a042a3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:42.323051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4f277-cca4-4628-8648-b18319eed0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:42.323712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f277-cca4-4628-8648-b18319eed0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.323996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f277-cca4-4628-8648-b18319eed0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.324274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f277-cca4-4628-8648-b18319eed0f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.325274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4f277-cca4-4628-8648-b18319eed0f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:42.325510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4f277-cca4-4628-8648-b18319eed0f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:42.326961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4f277-cca4-4628-8648-b18319eed0f1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:42.339170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 495/978] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:42.345139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c54894-0cad-4fbf-b3f8-5751ed67951f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:42.406676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:42.451126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c54894-0cad-4fbf-b3f8-5751ed67951f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:42.486627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cdb0b-20fe-48da-9695-6e43a36c3da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:42.487399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cdb0b-20fe-48da-9695-6e43a36c3da5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.487753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cdb0b-20fe-48da-9695-6e43a36c3da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.488118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cdb0b-20fe-48da-9695-6e43a36c3da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.489037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cdb0b-20fe-48da-9695-6e43a36c3da5 None admin] RBAC: Adding query filter params (role.id=c88603395e0444799ae7807bcb6a3ffe, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=7255df373d794cf8b2548b3c0876dd22) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:42.489424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cdb0b-20fe-48da-9695-6e43a36c3da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:42.490979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cdb0b-20fe-48da-9695-6e43a36c3da5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:42.505922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 484/979] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:42 2022] GET /identity/v3/role_assignments?user.id=7255df373d794cf8b2548b3c0876dd22&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=c88603395e0444799ae7807bcb6a3ffe => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:42.905906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f05eb-7b71-46de-974b-9132701735d2 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.906434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f05eb-7b71-46de-974b-9132701735d2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.906434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f05eb-7b71-46de-974b-9132701735d2 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.907983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 496/980] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:42.913285 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dae03-5b44-4e69-afa4-b056bb749310 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.913674 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dae03-5b44-4e69-afa4-b056bb749310 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.913836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dae03-5b44-4e69-afa4-b056bb749310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.930692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-e35dae03-5b44-4e69-afa4-b056bb749310 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:42.931872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e35dae03-5b44-4e69-afa4-b056bb749310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:43.006183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 485/981] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:43.029328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f05eb-7b71-46de-974b-9132701735d2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.030886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464a28-9459-4509-a163-11f440f3ae8d None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.031170 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464a28-9459-4509-a163-11f440f3ae8d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.031445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464a28-9459-4509-a163-11f440f3ae8d None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.032962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 486/982] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:43.037781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1645d-0c6e-4597-81bf-5ed8f2ea48d2 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.038101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1645d-0c6e-4597-81bf-5ed8f2ea48d2 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.038380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1645d-0c6e-4597-81bf-5ed8f2ea48d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.060739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4fb1645d-0c6e-4597-81bf-5ed8f2ea48d2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:43.061942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4fb1645d-0c6e-4597-81bf-5ed8f2ea48d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:43.112002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:43.133551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 487/983] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:42:43.141117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:43.146113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f05eb-7b71-46de-974b-9132701735d2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.156430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1645d-0c6e-4597-81bf-5ed8f2ea48d2 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.183584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf2a11-9bba-4b71-814e-77d43b0157e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.185388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf2a11-9bba-4b71-814e-77d43b0157e7 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.185505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf2a11-9bba-4b71-814e-77d43b0157e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.186035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf2a11-9bba-4b71-814e-77d43b0157e7 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.187044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf2a11-9bba-4b71-814e-77d43b0157e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.188545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf2a11-9bba-4b71-814e-77d43b0157e7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:43.214274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 497/984] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:43 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:43.265897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1645d-0c6e-4597-81bf-5ed8f2ea48d2 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.311526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a0dac-8b4a-42e3-abbf-0deb729571d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.312357 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0dac-8b4a-42e3-abbf-0deb729571d0 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.312633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0dac-8b4a-42e3-abbf-0deb729571d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.312899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0dac-8b4a-42e3-abbf-0deb729571d0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.313552 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a0dac-8b4a-42e3-abbf-0deb729571d0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.314973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a0dac-8b4a-42e3-abbf-0deb729571d0 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-7a5a0dac-8b4a-42e3-abbf-0deb729571d0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:43.328230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:43.329305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:43.330634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:43.334264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 488/985] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Jun 16 14:42:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:43.335553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf2a11-9bba-4b71-814e-77d43b0157e7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.448929 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf2a11-9bba-4b71-814e-77d43b0157e7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.484446 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a69a7-50dd-4516-8d9d-004dcf745ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.485444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a69a7-50dd-4516-8d9d-004dcf745ebe None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.485960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a69a7-50dd-4516-8d9d-004dcf745ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.486433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a69a7-50dd-4516-8d9d-004dcf745ebe None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.487327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a69a7-50dd-4516-8d9d-004dcf745ebe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:43.487858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a69a7-50dd-4516-8d9d-004dcf745ebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.489419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a69a7-50dd-4516-8d9d-004dcf745ebe None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:43.494960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 498/986] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Jun 16 14:42:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:43.501834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a0dac-8b4a-42e3-abbf-0deb729571d0 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.547963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:43.608163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a0dac-8b4a-42e3-abbf-0deb729571d0 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.642112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ddd5-377f-452f-9e51-aacda7a12fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.642777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ddd5-377f-452f-9e51-aacda7a12fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.643053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ddd5-377f-452f-9e51-aacda7a12fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.643321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ddd5-377f-452f-9e51-aacda7a12fe4 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.644023 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7ddd5-377f-452f-9e51-aacda7a12fe4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:43.644323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7ddd5-377f-452f-9e51-aacda7a12fe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.645674 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7ddd5-377f-452f-9e51-aacda7a12fe4 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:43.650682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 489/987] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Jun 16 14:42:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:43.660840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a69a7-50dd-4516-8d9d-004dcf745ebe None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.689716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:43.770147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a69a7-50dd-4516-8d9d-004dcf745ebe None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.804298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae8875-0419-4a09-b8c0-6a17e716051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.804955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae8875-0419-4a09-b8c0-6a17e716051f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.805233 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae8875-0419-4a09-b8c0-6a17e716051f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.805502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae8875-0419-4a09-b8c0-6a17e716051f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.806317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae8875-0419-4a09-b8c0-6a17e716051f None admin] RBAC: Adding query filter params (interface=admin, service_id=beac9e6da47b498e82f9d41debebad7a, region_id=RegionOne) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:43.806628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae8875-0419-4a09-b8c0-6a17e716051f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.807981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae8875-0419-4a09-b8c0-6a17e716051f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:43.814135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 499/988] 10.222.0.81 () {56 vars in 1249 bytes} [Thu Jun 16 14:42:43 2022] GET /identity/v3/endpoints?service_id=beac9e6da47b498e82f9d41debebad7a&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:43.820066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ddd5-377f-452f-9e51-aacda7a12fe4 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.952695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ddd5-377f-452f-9e51-aacda7a12fe4 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.959806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:43.989528 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27507d4-11d2-4f15-acdb-59861cd901c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.990226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27507d4-11d2-4f15-acdb-59861cd901c8 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.990510 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27507d4-11d2-4f15-acdb-59861cd901c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.990788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27507d4-11d2-4f15-acdb-59861cd901c8 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.991465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27507d4-11d2-4f15-acdb-59861cd901c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.992834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27507d4-11d2-4f15-acdb-59861cd901c8 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:44.000616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 490/989] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Jun 16 14:42:43 2022] GET /identity/v3/services => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:42:44.739645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25930e63-2571-4bd9-9334-721aeae65e5c None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:44.740284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25930e63-2571-4bd9-9334-721aeae65e5c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:44.740284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25930e63-2571-4bd9-9334-721aeae65e5c None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:44.741746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 500/990] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:44.746816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb900-defb-4a67-a059-c8e9fb3e48bb None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:44.747227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb900-defb-4a67-a059-c8e9fb3e48bb None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:44.747588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb900-defb-4a67-a059-c8e9fb3e48bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:44.765675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6baeb900-defb-4a67-a059-c8e9fb3e48bb None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:44.766982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6baeb900-defb-4a67-a059-c8e9fb3e48bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:44.838461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 491/991] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:44.861057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25930e63-2571-4bd9-9334-721aeae65e5c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:44.953356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:44.968225 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25930e63-2571-4bd9-9334-721aeae65e5c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.004053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bd926-05b8-401b-8261-6a5c49f41183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.004835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bd926-05b8-401b-8261-6a5c49f41183 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.005111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bd926-05b8-401b-8261-6a5c49f41183 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.005381 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bd926-05b8-401b-8261-6a5c49f41183 None admin] PATH_INFO: `/v3/services/image` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.006051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bd926-05b8-401b-8261-6a5c49f41183 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.007392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bd926-05b8-401b-8261-6a5c49f41183 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-db2bd926-05b8-401b-8261-6a5c49f41183 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:45.019121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:45.020153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:42:45.021065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:45.025135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 501/992] 10.222.0.81 () {56 vars in 1105 bytes} [Thu Jun 16 14:42:44 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:45.026405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baeb900-defb-4a67-a059-c8e9fb3e48bb None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.137501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.142211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baeb900-defb-4a67-a059-c8e9fb3e48bb None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.183491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941a076-a426-4bf7-81fb-09dec918ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.184191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941a076-a426-4bf7-81fb-09dec918ce2d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.184464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941a076-a426-4bf7-81fb-09dec918ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.184946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941a076-a426-4bf7-81fb-09dec918ce2d None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.185657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941a076-a426-4bf7-81fb-09dec918ce2d None admin] RBAC: Adding query filter params (name=image) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:45.185995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941a076-a426-4bf7-81fb-09dec918ce2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.187355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941a076-a426-4bf7-81fb-09dec918ce2d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:45.197561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 492/993] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:45.198870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bd926-05b8-401b-8261-6a5c49f41183 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.305916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bd926-05b8-401b-8261-6a5c49f41183 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.342021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b56d3-ee0f-4a37-b095-7519991c0647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.342715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b56d3-ee0f-4a37-b095-7519991c0647 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.343002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b56d3-ee0f-4a37-b095-7519991c0647 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.343278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b56d3-ee0f-4a37-b095-7519991c0647 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.344007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b56d3-ee0f-4a37-b095-7519991c0647 None admin] RBAC: Adding query filter params (type=image) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:45.344317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b56d3-ee0f-4a37-b095-7519991c0647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.345726 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b56d3-ee0f-4a37-b095-7519991c0647 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:45.357948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 502/994] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:45.404595 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db926-d3bd-4b7d-9940-d3296977de91 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.404916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db926-d3bd-4b7d-9940-d3296977de91 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.405153 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db926-d3bd-4b7d-9940-d3296977de91 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.406855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 493/995] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:45.412715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c48c-21de-4977-851e-92443d4489f2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.413052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c48c-21de-4977-851e-92443d4489f2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.413279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c48c-21de-4977-851e-92443d4489f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.431165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c061c48c-21de-4977-851e-92443d4489f2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:45.432727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c061c48c-21de-4977-851e-92443d4489f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:45.445870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.509558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 503/996] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:45.533803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294db926-d3bd-4b7d-9940-d3296977de91 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.645057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294db926-d3bd-4b7d-9940-d3296977de91 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.687031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57679533-8207-428a-9ada-3ef49d031b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.687866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679533-8207-428a-9ada-3ef49d031b6c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.688145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679533-8207-428a-9ada-3ef49d031b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.688414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679533-8207-428a-9ada-3ef49d031b6c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.689057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57679533-8207-428a-9ada-3ef49d031b6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.690454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57679533-8207-428a-9ada-3ef49d031b6c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-57679533-8207-428a-9ada-3ef49d031b6c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:45.703200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:45.704246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:45.705083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 494/997] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:45.710312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061c48c-21de-4977-851e-92443d4489f2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.813804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061c48c-21de-4977-851e-92443d4489f2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.850681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745f256-c087-42a1-9176-6bec29270616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.851349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f256-c087-42a1-9176-6bec29270616 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.851629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f256-c087-42a1-9176-6bec29270616 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.851900 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f256-c087-42a1-9176-6bec29270616 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.852599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745f256-c087-42a1-9176-6bec29270616 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:45.852904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745f256-c087-42a1-9176-6bec29270616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.854286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745f256-c087-42a1-9176-6bec29270616 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:45.859439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 504/998] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:45.864876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57679533-8207-428a-9ada-3ef49d031b6c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.895933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.969322 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57679533-8207-428a-9ada-3ef49d031b6c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.004168 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d4308-8a61-41b1-a1ce-0704cb083eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.004838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4308-8a61-41b1-a1ce-0704cb083eef None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.005121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4308-8a61-41b1-a1ce-0704cb083eef None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.005397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4308-8a61-41b1-a1ce-0704cb083eef None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.006126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d4308-8a61-41b1-a1ce-0704cb083eef None admin] RBAC: Adding query filter params (type=compute) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:46.006434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d4308-8a61-41b1-a1ce-0704cb083eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.007801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d4308-8a61-41b1-a1ce-0704cb083eef None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.017990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 495/999] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:46.019289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745f256-c087-42a1-9176-6bec29270616 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.032730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.128710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745f256-c087-42a1-9176-6bec29270616 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.165674 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368454-71ed-4f94-b7f0-db7824786ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.166286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368454-71ed-4f94-b7f0-db7824786ccb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.166569 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368454-71ed-4f94-b7f0-db7824786ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.166853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368454-71ed-4f94-b7f0-db7824786ccb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.167633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368454-71ed-4f94-b7f0-db7824786ccb None admin] RBAC: Adding query filter params (interface=public, service_id=6c53add8aeff472093fe7df27905e813, region_id=RegionOne) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:46.167945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368454-71ed-4f94-b7f0-db7824786ccb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.170019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368454-71ed-4f94-b7f0-db7824786ccb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.175134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494503d3-f219-4c78-a41b-c2131007dd12 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.175584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494503d3-f219-4c78-a41b-c2131007dd12 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.175682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494503d3-f219-4c78-a41b-c2131007dd12 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.177334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 496/1000] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:46.178028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 505/1001] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/endpoints?service_id=6c53add8aeff472093fe7df27905e813&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:46.180733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494503d3-f219-4c78-a41b-c2131007dd12 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.182850 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1fc9d-1b74-4bb7-a6b0-cae93174ecee None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.183139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1fc9d-1b74-4bb7-a6b0-cae93174ecee None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.183416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1fc9d-1b74-4bb7-a6b0-cae93174ecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.202179 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-48e1fc9d-1b74-4bb7-a6b0-cae93174ecee None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:46.203388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-48e1fc9d-1b74-4bb7-a6b0-cae93174ecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:46.286246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.290713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 506/1002] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:42:46.297472 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494503d3-f219-4c78-a41b-c2131007dd12 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.314040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1fc9d-1b74-4bb7-a6b0-cae93174ecee None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.317088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.336157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08e51e-893d-48ed-bbad-46039ede8a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.336837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08e51e-893d-48ed-bbad-46039ede8a9e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.337114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08e51e-893d-48ed-bbad-46039ede8a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.337392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08e51e-893d-48ed-bbad-46039ede8a9e None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.338097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08e51e-893d-48ed-bbad-46039ede8a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.339475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08e51e-893d-48ed-bbad-46039ede8a9e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.350258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 497/1003] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:42:46.430479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1fc9d-1b74-4bb7-a6b0-cae93174ecee None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.471559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd12d5-4349-4f5d-9ac2-5852cd6f1992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.472451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd12d5-4349-4f5d-9ac2-5852cd6f1992 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.472736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd12d5-4349-4f5d-9ac2-5852cd6f1992 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.473042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd12d5-4349-4f5d-9ac2-5852cd6f1992 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.473772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd12d5-4349-4f5d-9ac2-5852cd6f1992 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.475300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd12d5-4349-4f5d-9ac2-5852cd6f1992 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f1fd12d5-4349-4f5d-9ac2-5852cd6f1992 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:46.489085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:46.490216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:46.491281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 507/1004] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:46.497167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08e51e-893d-48ed-bbad-46039ede8a9e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.607146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08e51e-893d-48ed-bbad-46039ede8a9e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.643109 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b33b4f-666a-4ca1-8a93-0490192d9aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.643777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b33b4f-666a-4ca1-8a93-0490192d9aaa None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.644063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b33b4f-666a-4ca1-8a93-0490192d9aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.644339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b33b4f-666a-4ca1-8a93-0490192d9aaa None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.645040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b33b4f-666a-4ca1-8a93-0490192d9aaa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:46.645346 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b33b4f-666a-4ca1-8a93-0490192d9aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.646760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b33b4f-666a-4ca1-8a93-0490192d9aaa None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.657131 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 498/1005] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:46.659276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd12d5-4349-4f5d-9ac2-5852cd6f1992 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.736600 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.772509 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd12d5-4349-4f5d-9ac2-5852cd6f1992 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.807552 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643ed1-394f-46c6-9789-bbe162167a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.808223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643ed1-394f-46c6-9789-bbe162167a25 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.808504 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643ed1-394f-46c6-9789-bbe162167a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.808900 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643ed1-394f-46c6-9789-bbe162167a25 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.810753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2643ed1-394f-46c6-9789-bbe162167a25 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:46.811063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2643ed1-394f-46c6-9789-bbe162167a25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.812432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2643ed1-394f-46c6-9789-bbe162167a25 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.821954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 508/1006] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:46.823059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b33b4f-666a-4ca1-8a93-0490192d9aaa None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.847784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.943143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b33b4f-666a-4ca1-8a93-0490192d9aaa None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.979190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e95b23-75ec-4713-991b-c4c352e0dabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.979899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95b23-75ec-4713-991b-c4c352e0dabe None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.980216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95b23-75ec-4713-991b-c4c352e0dabe None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.980517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95b23-75ec-4713-991b-c4c352e0dabe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.982002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e95b23-75ec-4713-991b-c4c352e0dabe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.983439 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e95b23-75ec-4713-991b-c4c352e0dabe None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:47.005997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 499/1007] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Jun 16 14:42:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:42:47.519599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2df7c-f0f8-40b4-963b-470dabcf21d3 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:47.519998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2df7c-f0f8-40b4-963b-470dabcf21d3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:47.520203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2df7c-f0f8-40b4-963b-470dabcf21d3 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:47.521665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 509/1008] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:47.526608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f535ed-669f-4e74-b328-a93f10973d80 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:47.527040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f535ed-669f-4e74-b328-a93f10973d80 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:47.527201 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f535ed-669f-4e74-b328-a93f10973d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:47.545527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d1f535ed-669f-4e74-b328-a93f10973d80 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:47.547091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d1f535ed-669f-4e74-b328-a93f10973d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:47.623686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 500/1009] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:47 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:47.646524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2df7c-f0f8-40b4-963b-470dabcf21d3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:47.755070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2df7c-f0f8-40b4-963b-470dabcf21d3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:47.785686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:47.791515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ccf94-59ac-4c1f-b0c0-9f8596bae352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:47.792182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ccf94-59ac-4c1f-b0c0-9f8596bae352 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:47.792462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ccf94-59ac-4c1f-b0c0-9f8596bae352 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:47.792735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ccf94-59ac-4c1f-b0c0-9f8596bae352 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:47.794213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ccf94-59ac-4c1f-b0c0-9f8596bae352 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:47.795750 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ccf94-59ac-4c1f-b0c0-9f8596bae352 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:47.817931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 510/1010] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:47 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:48.506002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407f03-614a-49b7-8bb2-f96dbb1a6b25 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.506395 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407f03-614a-49b7-8bb2-f96dbb1a6b25 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.506542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407f03-614a-49b7-8bb2-f96dbb1a6b25 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.508068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 501/1011] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:48.513643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cd057-7ff7-4b89-9ba8-6bd8dde70763 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.514179 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cd057-7ff7-4b89-9ba8-6bd8dde70763 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.514274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cd057-7ff7-4b89-9ba8-6bd8dde70763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.531114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4c2cd057-7ff7-4b89-9ba8-6bd8dde70763 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:48.532297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4c2cd057-7ff7-4b89-9ba8-6bd8dde70763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:48.607462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 511/1012] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:48 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:48.630216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76407f03-614a-49b7-8bb2-f96dbb1a6b25 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:48.640064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:48.745484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76407f03-614a-49b7-8bb2-f96dbb1a6b25 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:48.781050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e954e04-acd2-4064-ba1b-4b0f5e3e710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:48.781765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954e04-acd2-4064-ba1b-4b0f5e3e710a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.782070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954e04-acd2-4064-ba1b-4b0f5e3e710a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.782340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954e04-acd2-4064-ba1b-4b0f5e3e710a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.782981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e954e04-acd2-4064-ba1b-4b0f5e3e710a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:48.784330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e954e04-acd2-4064-ba1b-4b0f5e3e710a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-4e954e04-acd2-4064-ba1b-4b0f5e3e710a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:48.796282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:48.797277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:42:48.798143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:48.799755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 502/1013] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:48.803313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cd057-7ff7-4b89-9ba8-6bd8dde70763 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:48.905808 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cd057-7ff7-4b89-9ba8-6bd8dde70763 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:48.930562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:48.951002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141d10a-db0d-42ff-ab3d-4bf761ad9b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:48.951672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141d10a-db0d-42ff-ab3d-4bf761ad9b94 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.951955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141d10a-db0d-42ff-ab3d-4bf761ad9b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.952314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141d10a-db0d-42ff-ab3d-4bf761ad9b94 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.953121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141d10a-db0d-42ff-ab3d-4bf761ad9b94 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:48.953233 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141d10a-db0d-42ff-ab3d-4bf761ad9b94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:48.954628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141d10a-db0d-42ff-ab3d-4bf761ad9b94 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:48.964189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 512/1014] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:48.965566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e954e04-acd2-4064-ba1b-4b0f5e3e710a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:49.040513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:49.074947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e954e04-acd2-4064-ba1b-4b0f5e3e710a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:49.112680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc9002-dfd3-4ae1-a9f2-a112a01229d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:49.113373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc9002-dfd3-4ae1-a9f2-a112a01229d5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.113657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc9002-dfd3-4ae1-a9f2-a112a01229d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.113960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc9002-dfd3-4ae1-a9f2-a112a01229d5 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.114689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc9002-dfd3-4ae1-a9f2-a112a01229d5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:49.114995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc9002-dfd3-4ae1-a9f2-a112a01229d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:49.116405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc9002-dfd3-4ae1-a9f2-a112a01229d5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:49.127654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 503/1015] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Jun 16 14:42:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:49.128643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141d10a-db0d-42ff-ab3d-4bf761ad9b94 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:49.167324 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0abec-4069-483c-8405-811382ccdb66 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.167665 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0abec-4069-483c-8405-811382ccdb66 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.167872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0abec-4069-483c-8405-811382ccdb66 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.169575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 504/1016] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:49.174387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5870746-a27e-4b5e-af5e-ec7b0c75fcf3 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.174676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5870746-a27e-4b5e-af5e-ec7b0c75fcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.174950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5870746-a27e-4b5e-af5e-ec7b0c75fcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.192306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d5870746-a27e-4b5e-af5e-ec7b0c75fcf3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:49.193483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d5870746-a27e-4b5e-af5e-ec7b0c75fcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:49.237915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141d10a-db0d-42ff-ab3d-4bf761ad9b94 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:49.274541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef82a-b8d5-490e-9b18-6e1ddab00d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:49.275133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef82a-b8d5-490e-9b18-6e1ddab00d3f None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.277926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef82a-b8d5-490e-9b18-6e1ddab00d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.277926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef82a-b8d5-490e-9b18-6e1ddab00d3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.278151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 505/1017] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:49 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:42:49.278232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebef82a-b8d5-490e-9b18-6e1ddab00d3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:49.278232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebef82a-b8d5-490e-9b18-6e1ddab00d3f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:49.298892 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 513/1018] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Jun 16 14:42:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:42:49.299700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5870746-a27e-4b5e-af5e-ec7b0c75fcf3 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:49.375374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:49.422514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5870746-a27e-4b5e-af5e-ec7b0c75fcf3 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:49.468706 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fd4fc-8d7c-4301-b648-8a130bc8edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:49.469275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd4fc-8d7c-4301-b648-8a130bc8edfd None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.469562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd4fc-8d7c-4301-b648-8a130bc8edfd None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.469837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd4fc-8d7c-4301-b648-8a130bc8edfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.471857 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fd4fc-8d7c-4301-b648-8a130bc8edfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:49.473338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fd4fc-8d7c-4301-b648-8a130bc8edfd None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:49.475191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 506/1019] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:49.481835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef82a-b8d5-490e-9b18-6e1ddab00d3f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:49.527104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:49.598352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef82a-b8d5-490e-9b18-6e1ddab00d3f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:49.632662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ad6c-15f9-4a4a-8572-ba2c0eb8b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:49.633332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ad6c-15f9-4a4a-8572-ba2c0eb8b2fd None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.633610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ad6c-15f9-4a4a-8572-ba2c0eb8b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.633897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ad6c-15f9-4a4a-8572-ba2c0eb8b2fd None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.634623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20ad6c-15f9-4a4a-8572-ba2c0eb8b2fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:49.636040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20ad6c-15f9-4a4a-8572-ba2c0eb8b2fd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:49.672064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 514/1020] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:49 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:49.994056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44178d3-93d1-4db7-8ed2-ec0a87109568 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.994602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44178d3-93d1-4db7-8ed2-ec0a87109568 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.994602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44178d3-93d1-4db7-8ed2-ec0a87109568 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.996149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 507/1021] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:50.001352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1975-698d-448f-8cb6-a336d0187e36 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.001649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1975-698d-448f-8cb6-a336d0187e36 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.001950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1975-698d-448f-8cb6-a336d0187e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.019325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ae0e1975-698d-448f-8cb6-a336d0187e36 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:50.020510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ae0e1975-698d-448f-8cb6-a336d0187e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:50.089276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 515/1022] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:50.111640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44178d3-93d1-4db7-8ed2-ec0a87109568 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:50.220570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44178d3-93d1-4db7-8ed2-ec0a87109568 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:50.248220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:50.257339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108136b-8090-48df-a526-65e02799a407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:50.258161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108136b-8090-48df-a526-65e02799a407 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.258449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108136b-8090-48df-a526-65e02799a407 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.258729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108136b-8090-48df-a526-65e02799a407 None admin] PATH_INFO: `/v3/services/image` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.259382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108136b-8090-48df-a526-65e02799a407 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:50.260752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108136b-8090-48df-a526-65e02799a407 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-c108136b-8090-48df-a526-65e02799a407 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:50.274076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:50.275149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:42:50.276142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:50.281699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e1975-698d-448f-8cb6-a336d0187e36 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:50.283749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 508/1023] 10.222.0.81 () {56 vars in 1105 bytes} [Thu Jun 16 14:42:50 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:50.303517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:50.385191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e1975-698d-448f-8cb6-a336d0187e36 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:50.422046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9af7db-ea50-4330-bcef-38431b87f851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:50.422717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9af7db-ea50-4330-bcef-38431b87f851 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.423077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9af7db-ea50-4330-bcef-38431b87f851 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.423399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9af7db-ea50-4330-bcef-38431b87f851 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.424167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9af7db-ea50-4330-bcef-38431b87f851 None admin] RBAC: Adding query filter params (name=image) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:50.424499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9af7db-ea50-4330-bcef-38431b87f851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:50.425982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9af7db-ea50-4330-bcef-38431b87f851 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:50.431314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 516/1024] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:50.436679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108136b-8090-48df-a526-65e02799a407 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:50.549465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108136b-8090-48df-a526-65e02799a407 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:50.585029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df87ff-9a6b-4bb0-b3f9-dbb47270a031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:50.585734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df87ff-9a6b-4bb0-b3f9-dbb47270a031 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.586049 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df87ff-9a6b-4bb0-b3f9-dbb47270a031 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.586327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df87ff-9a6b-4bb0-b3f9-dbb47270a031 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.587057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df87ff-9a6b-4bb0-b3f9-dbb47270a031 None admin] RBAC: Adding query filter params (type=image) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:50.587456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df87ff-9a6b-4bb0-b3f9-dbb47270a031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:50.588926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df87ff-9a6b-4bb0-b3f9-dbb47270a031 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:50.599194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 509/1025] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:50.600311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9af7db-ea50-4330-bcef-38431b87f851 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:50.694379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:50.712113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9af7db-ea50-4330-bcef-38431b87f851 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:50.748966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e798a0e-847e-4649-a46a-848786e2923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:50.750106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e798a0e-847e-4649-a46a-848786e2923e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.750591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e798a0e-847e-4649-a46a-848786e2923e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.751099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e798a0e-847e-4649-a46a-848786e2923e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.752140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e798a0e-847e-4649-a46a-848786e2923e None admin] RBAC: Adding query filter params (interface=public, service_id=9790defc2da94371a8353a5669706dc5, region_id=RegionOne) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:50.752649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e798a0e-847e-4649-a46a-848786e2923e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:50.754268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e798a0e-847e-4649-a46a-848786e2923e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:50.760140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 517/1026] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Jun 16 14:42:50 2022] GET /identity/v3/endpoints?service_id=9790defc2da94371a8353a5669706dc5&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:50.766027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df87ff-9a6b-4bb0-b3f9-dbb47270a031 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:50.827507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:50.877646 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df87ff-9a6b-4bb0-b3f9-dbb47270a031 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:50.912290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff16e1-e465-4959-b003-c9d6e310ff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:50.912955 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff16e1-e465-4959-b003-c9d6e310ff69 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.913234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff16e1-e465-4959-b003-c9d6e310ff69 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.913507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff16e1-e465-4959-b003-c9d6e310ff69 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.914223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff16e1-e465-4959-b003-c9d6e310ff69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:50.915601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff16e1-e465-4959-b003-c9d6e310ff69 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:50.925017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 510/1027] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Jun 16 14:42:50 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:42:51.578230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367cba-1ccf-4fe7-8c70-61abb20f0c96 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.578654 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367cba-1ccf-4fe7-8c70-61abb20f0c96 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.578837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367cba-1ccf-4fe7-8c70-61abb20f0c96 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.580403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 518/1028] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:51.585580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ddd2-8d37-44ae-8191-06c8b97a78a8 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.586047 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ddd2-8d37-44ae-8191-06c8b97a78a8 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.586170 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ddd2-8d37-44ae-8191-06c8b97a78a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.603852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-fc59ddd2-8d37-44ae-8191-06c8b97a78a8 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:51.605037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-fc59ddd2-8d37-44ae-8191-06c8b97a78a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:51.680696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 511/1029] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:51.704495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a367cba-1ccf-4fe7-8c70-61abb20f0c96 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:51.808531 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a367cba-1ccf-4fe7-8c70-61abb20f0c96 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:51.843116 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e00d4b-f53e-4cd7-a288-a3c1e183b639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:51.843845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00d4b-f53e-4cd7-a288-a3c1e183b639 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.844157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00d4b-f53e-4cd7-a288-a3c1e183b639 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.844388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00d4b-f53e-4cd7-a288-a3c1e183b639 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.854329 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e00d4b-f53e-4cd7-a288-a3c1e183b639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-e9e00d4b-f53e-4cd7-a288-a3c1e183b639 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:51.862888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:51.863974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:42:51.864817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:51.866281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 519/1030] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Jun 16 14:42:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:51.870400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ddd2-8d37-44ae-8191-06c8b97a78a8 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:51.925276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:51.941847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d911608-89b0-4716-822a-316324fb9be1 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.942157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d911608-89b0-4716-822a-316324fb9be1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.942426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d911608-89b0-4716-822a-316324fb9be1 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.943955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 520/1031] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:51.948578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a0917-f924-4f42-9890-7f0dac5d0fca None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.948864 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a0917-f924-4f42-9890-7f0dac5d0fca None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.949138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a0917-f924-4f42-9890-7f0dac5d0fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.966432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6a1a0917-f924-4f42-9890-7f0dac5d0fca None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:51.967615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6a1a0917-f924-4f42-9890-7f0dac5d0fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:51.969684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:51.983746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ddd2-8d37-44ae-8191-06c8b97a78a8 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.024541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ded5fb-d481-4b55-a368-f72ea7cfc7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.025691 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ded5fb-d481-4b55-a368-f72ea7cfc7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.026361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ded5fb-d481-4b55-a368-f72ea7cfc7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.026656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ded5fb-d481-4b55-a368-f72ea7cfc7c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.027566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ded5fb-d481-4b55-a368-f72ea7cfc7c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:52.028417 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ded5fb-d481-4b55-a368-f72ea7cfc7c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.030090 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ded5fb-d481-4b55-a368-f72ea7cfc7c9 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.038295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 521/1032] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:42:52.044557 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 512/1033] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Jun 16 14:42:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:52.047042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a0917-f924-4f42-9890-7f0dac5d0fca None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.062807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ded5fb-d481-4b55-a368-f72ea7cfc7c9 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.162577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a0917-f924-4f42-9890-7f0dac5d0fca None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.172191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ded5fb-d481-4b55-a368-f72ea7cfc7c9 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.188449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.200752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633143b-6216-413c-8505-c2307dff1d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.201701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633143b-6216-413c-8505-c2307dff1d44 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.202075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633143b-6216-413c-8505-c2307dff1d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.202444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633143b-6216-413c-8505-c2307dff1d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.209177 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.212012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd930d-f879-4d72-9def-f749b5f22b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.212790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd930d-f879-4d72-9def-f749b5f22b35 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.212994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd930d-f879-4d72-9def-f749b5f22b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.213274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd930d-f879-4d72-9def-f749b5f22b35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.214427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633143b-6216-413c-8505-c2307dff1d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.214534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd930d-f879-4d72-9def-f749b5f22b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.215943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd930d-f879-4d72-9def-f749b5f22b35 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.216279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633143b-6216-413c-8505-c2307dff1d44 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.222338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 513/1034] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:52.222960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd930d-f879-4d72-9def-f749b5f22b35 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-5633143b-6216-413c-8505-c2307dff1d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:52.235133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:52.236205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:52.237303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:52.237303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:52.237303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:52.237303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:52.241023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 522/1035] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:52.241903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633143b-6216-413c-8505-c2307dff1d44 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.339063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd930d-f879-4d72-9def-f749b5f22b35 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.352662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633143b-6216-413c-8505-c2307dff1d44 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.378182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebf72a-2468-428c-9c50-eb1d6fd36ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.378778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebf72a-2468-428c-9c50-eb1d6fd36ae7 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.379062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebf72a-2468-428c-9c50-eb1d6fd36ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.379338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebf72a-2468-428c-9c50-eb1d6fd36ae7 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.380060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebf72a-2468-428c-9c50-eb1d6fd36ae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.381496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebf72a-2468-428c-9c50-eb1d6fd36ae7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.390400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7ed41-47a1-4bff-9ba9-5d15c0edaf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.391070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7ed41-47a1-4bff-9ba9-5d15c0edaf0b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.391931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7ed41-47a1-4bff-9ba9-5d15c0edaf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.392323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7ed41-47a1-4bff-9ba9-5d15c0edaf0b None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.393760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7ed41-47a1-4bff-9ba9-5d15c0edaf0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:52.394088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7ed41-47a1-4bff-9ba9-5d15c0edaf0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.395547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7ed41-47a1-4bff-9ba9-5d15c0edaf0b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.406621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 514/1036] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:42:52 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:52.413050 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 523/1037] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:52.419297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebf72a-2468-428c-9c50-eb1d6fd36ae7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.461004 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.539963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebf72a-2468-428c-9c50-eb1d6fd36ae7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.578945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581b4fa-0c8e-4502-8032-ab81bd6c2c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.579791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581b4fa-0c8e-4502-8032-ab81bd6c2c51 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.580101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581b4fa-0c8e-4502-8032-ab81bd6c2c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.580399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581b4fa-0c8e-4502-8032-ab81bd6c2c51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.589314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581b4fa-0c8e-4502-8032-ab81bd6c2c51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.591591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581b4fa-0c8e-4502-8032-ab81bd6c2c51 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-3581b4fa-0c8e-4502-8032-ab81bd6c2c51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:52.608394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:52.609682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:52.610664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:52.610664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:52.610664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:52.610664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:52.610664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:52.610664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:52.610664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:52.610664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:52.610664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:52.610664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:52.610664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 515/1038] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:52.615335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7ed41-47a1-4bff-9ba9-5d15c0edaf0b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.676650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.729332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7ed41-47a1-4bff-9ba9-5d15c0edaf0b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.765502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca0d4e-d6a9-4c81-aca9-1e08927ac5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.766204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca0d4e-d6a9-4c81-aca9-1e08927ac5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.766481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca0d4e-d6a9-4c81-aca9-1e08927ac5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.766749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca0d4e-d6a9-4c81-aca9-1e08927ac5a9 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.767579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca0d4e-d6a9-4c81-aca9-1e08927ac5a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:52.767948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca0d4e-d6a9-4c81-aca9-1e08927ac5a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.769424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca0d4e-d6a9-4c81-aca9-1e08927ac5a9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.791999 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 524/1039] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:52.794163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581b4fa-0c8e-4502-8032-ab81bd6c2c51 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.894143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.901152 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581b4fa-0c8e-4502-8032-ab81bd6c2c51 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.937312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df2400-1740-4a20-bfe6-92461fbd3a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.937720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df2400-1740-4a20-bfe6-92461fbd3a7b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.938039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df2400-1740-4a20-bfe6-92461fbd3a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.938311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df2400-1740-4a20-bfe6-92461fbd3a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.008062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df2400-1740-4a20-bfe6-92461fbd3a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.009517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df2400-1740-4a20-bfe6-92461fbd3a7b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.107741 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.115388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 516/1040] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:42:53.121008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca0d4e-d6a9-4c81-aca9-1e08927ac5a9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.144816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de733a-a284-41d2-8f94-03723d36c3ce None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.145100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de733a-a284-41d2-8f94-03723d36c3ce None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.145375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de733a-a284-41d2-8f94-03723d36c3ce None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.146797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 517/1041] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:53.151885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f31f0-eb22-498c-9821-a0c1a2f1a7ce None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.152171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f31f0-eb22-498c-9821-a0c1a2f1a7ce None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.153034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f31f0-eb22-498c-9821-a0c1a2f1a7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.169966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-711f31f0-eb22-498c-9821-a0c1a2f1a7ce None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:53.171158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-711f31f0-eb22-498c-9821-a0c1a2f1a7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:53.236013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca0d4e-d6a9-4c81-aca9-1e08927ac5a9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.242584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 518/1042] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:42:53.248671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.266755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f31f0-eb22-498c-9821-a0c1a2f1a7ce None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.275629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f46ba-e725-4615-b8ad-731362928dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.276700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f46ba-e725-4615-b8ad-731362928dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.276978 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f46ba-e725-4615-b8ad-731362928dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.277247 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f46ba-e725-4615-b8ad-731362928dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.289639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f46ba-e725-4615-b8ad-731362928dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.291121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f46ba-e725-4615-b8ad-731362928dd8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-df6f46ba-e725-4615-b8ad-731362928dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:53.310585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:53.311508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:53.312572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:53.312572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:53.312572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:53.312572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:53.312572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 525/1043] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:53.317281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f46ba-e725-4615-b8ad-731362928dd8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.382917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f31f0-eb22-498c-9821-a0c1a2f1a7ce None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.413118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.422217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f46ba-e725-4615-b8ad-731362928dd8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.424607 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60cd04-3515-46ce-a647-92639bbb3b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.425461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60cd04-3515-46ce-a647-92639bbb3b43 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.425772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60cd04-3515-46ce-a647-92639bbb3b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.426087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60cd04-3515-46ce-a647-92639bbb3b43 None admin] PATH_INFO: `/v3/services/image` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.426824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60cd04-3515-46ce-a647-92639bbb3b43 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.428319 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60cd04-3515-46ce-a647-92639bbb3b43 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-2d60cd04-3515-46ce-a647-92639bbb3b43 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:53.441402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:53.442434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:42:53.443276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:53.447856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 519/1044] 10.222.0.81 () {56 vars in 1105 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:53.448514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60cd04-3515-46ce-a647-92639bbb3b43 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.460921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3778c5-82bf-4b3d-a483-04bcdb6d98b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.461591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3778c5-82bf-4b3d-a483-04bcdb6d98b9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.462199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3778c5-82bf-4b3d-a483-04bcdb6d98b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.462482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3778c5-82bf-4b3d-a483-04bcdb6d98b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.463195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3778c5-82bf-4b3d-a483-04bcdb6d98b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:53.463501 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3778c5-82bf-4b3d-a483-04bcdb6d98b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.464889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3778c5-82bf-4b3d-a483-04bcdb6d98b9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.476934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 526/1045] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:53.483337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3778c5-82bf-4b3d-a483-04bcdb6d98b9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.507945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.557773 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60cd04-3515-46ce-a647-92639bbb3b43 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.595642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954741c-b845-494a-81e5-b4037aac1b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.596319 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954741c-b845-494a-81e5-b4037aac1b86 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.596604 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954741c-b845-494a-81e5-b4037aac1b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.596880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954741c-b845-494a-81e5-b4037aac1b86 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.597593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954741c-b845-494a-81e5-b4037aac1b86 None admin] RBAC: Adding query filter params (name=image) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:53.597970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954741c-b845-494a-81e5-b4037aac1b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.599341 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954741c-b845-494a-81e5-b4037aac1b86 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.608969 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 520/1046] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:53.609121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3778c5-82bf-4b3d-a483-04bcdb6d98b9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.610025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954741c-b845-494a-81e5-b4037aac1b86 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.646896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5ec2f-636b-4049-b93f-7e6d077458a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.647708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5ec2f-636b-4049-b93f-7e6d077458a1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.647993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5ec2f-636b-4049-b93f-7e6d077458a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.648272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5ec2f-636b-4049-b93f-7e6d077458a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.661296 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5ec2f-636b-4049-b93f-7e6d077458a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.663197 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5ec2f-636b-4049-b93f-7e6d077458a1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.677189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-76c5ec2f-636b-4049-b93f-7e6d077458a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:53.678127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:53.679191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:53.680102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:53.680102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:53.680102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:53.680102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:53.680102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:53.680102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:53.680102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:53.680102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:53.680102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 527/1047] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:53.685330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5ec2f-636b-4049-b93f-7e6d077458a1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.734073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954741c-b845-494a-81e5-b4037aac1b86 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.769595 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.771743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76bff0-830c-485c-be87-79d674414320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.772515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bff0-830c-485c-be87-79d674414320 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.772803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bff0-830c-485c-be87-79d674414320 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.773083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bff0-830c-485c-be87-79d674414320 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.773831 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76bff0-830c-485c-be87-79d674414320 None admin] RBAC: Adding query filter params (type=image) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:53.774173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76bff0-830c-485c-be87-79d674414320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.775546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76bff0-830c-485c-be87-79d674414320 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.781108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 521/1048] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:53.786914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76bff0-830c-485c-be87-79d674414320 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.792798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5ec2f-636b-4049-b93f-7e6d077458a1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.832384 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bdb57-ed22-419a-9095-7312893b1993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.833044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bdb57-ed22-419a-9095-7312893b1993 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.833320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bdb57-ed22-419a-9095-7312893b1993 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.833594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bdb57-ed22-419a-9095-7312893b1993 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.834395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bdb57-ed22-419a-9095-7312893b1993 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:53.834700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bdb57-ed22-419a-9095-7312893b1993 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.836105 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bdb57-ed22-419a-9095-7312893b1993 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.848404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 528/1049] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:53.854228 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bdb57-ed22-419a-9095-7312893b1993 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.905869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76bff0-830c-485c-be87-79d674414320 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.929302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.950710 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe439-d0f4-4718-a8ce-2b1414521435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.951689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe439-d0f4-4718-a8ce-2b1414521435 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.952023 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe439-d0f4-4718-a8ce-2b1414521435 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.952580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe439-d0f4-4718-a8ce-2b1414521435 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.953651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fe439-d0f4-4718-a8ce-2b1414521435 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.955944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fe439-d0f4-4718-a8ce-2b1414521435 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.957253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bdb57-ed22-419a-9095-7312893b1993 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.980006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 522/1050] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Jun 16 14:42:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:42:54.006476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce896e01-0db9-439b-9535-d29c6c4bc71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:54.007269 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce896e01-0db9-439b-9535-d29c6c4bc71d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.007614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce896e01-0db9-439b-9535-d29c6c4bc71d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.007954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce896e01-0db9-439b-9535-d29c6c4bc71d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.008881 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce896e01-0db9-439b-9535-d29c6c4bc71d None admin] RBAC: Adding query filter params (role.id=c88603395e0444799ae7807bcb6a3ffe, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=f2faa046b0294a0ba1090be84bb1cebc) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:54.009265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce896e01-0db9-439b-9535-d29c6c4bc71d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:54.010875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce896e01-0db9-439b-9535-d29c6c4bc71d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:54.015122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:54.026485 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 529/1051] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/role_assignments?user.id=f2faa046b0294a0ba1090be84bb1cebc&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=c88603395e0444799ae7807bcb6a3ffe => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:54.640004 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495006-3b93-41d3-9ed1-e0c1abacaabb None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.640562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495006-3b93-41d3-9ed1-e0c1abacaabb None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.640562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495006-3b93-41d3-9ed1-e0c1abacaabb None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.641999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 523/1052] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:54.647370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00db6a9-e240-4497-a161-510367def4db None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.647747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00db6a9-e240-4497-a161-510367def4db None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.648100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00db6a9-e240-4497-a161-510367def4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.666618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b00db6a9-e240-4497-a161-510367def4db None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:54.667812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b00db6a9-e240-4497-a161-510367def4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:54.739042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 530/1053] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:54.763141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab495006-3b93-41d3-9ed1-e0c1abacaabb None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:54.876587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab495006-3b93-41d3-9ed1-e0c1abacaabb None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:54.923514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3798ce2-d311-4640-996e-935ceae5a75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:54.924242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798ce2-d311-4640-996e-935ceae5a75e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.924527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798ce2-d311-4640-996e-935ceae5a75e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.924806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798ce2-d311-4640-996e-935ceae5a75e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.938934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3798ce2-d311-4640-996e-935ceae5a75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-f3798ce2-d311-4640-996e-935ceae5a75e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:54.946600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:54.947525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:54.948381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:54.949774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 524/1054] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:54.953948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00db6a9-e240-4497-a161-510367def4db None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.053985 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00db6a9-e240-4497-a161-510367def4db None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.083943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.091457 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e60fd-9cdc-4987-9115-462631c55a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.092063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e60fd-9cdc-4987-9115-462631c55a73 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.092342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e60fd-9cdc-4987-9115-462631c55a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.092612 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e60fd-9cdc-4987-9115-462631c55a73 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.093411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e60fd-9cdc-4987-9115-462631c55a73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:55.093715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e60fd-9cdc-4987-9115-462631c55a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.095102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e60fd-9cdc-4987-9115-462631c55a73 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.109347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 531/1055] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:55.110734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3798ce2-d311-4640-996e-935ceae5a75e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.149365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.224603 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3798ce2-d311-4640-996e-935ceae5a75e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.261669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9c540-ae5f-4382-a286-332f51f3ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.263154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9c540-ae5f-4382-a286-332f51f3ab25 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.263437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9c540-ae5f-4382-a286-332f51f3ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.263711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9c540-ae5f-4382-a286-332f51f3ab25 None admin] PATH_INFO: `/v3/users/90770cf7321640949cf8155e6d093e53` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.279698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9c540-ae5f-4382-a286-332f51f3ab25 None admin] RBAC: Authorizing `identity:get_user(user_id=90770cf7321640949cf8155e6d093e53)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.281193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9c540-ae5f-4382-a286-332f51f3ab25 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.283173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 525/1056] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:55 2022] GET /identity/v3/users/90770cf7321640949cf8155e6d093e53 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:55.288668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e60fd-9cdc-4987-9115-462631c55a73 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.393854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e60fd-9cdc-4987-9115-462631c55a73 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.428078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc740bb-1014-4581-9b49-d144a8305873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.428743 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc740bb-1014-4581-9b49-d144a8305873 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.429009 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc740bb-1014-4581-9b49-d144a8305873 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.429280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc740bb-1014-4581-9b49-d144a8305873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.486927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.497975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc740bb-1014-4581-9b49-d144a8305873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.499421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc740bb-1014-4581-9b49-d144a8305873 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.603211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 532/1057] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:42:55.604512 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9c540-ae5f-4382-a286-332f51f3ab25 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.704825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.715280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9c540-ae5f-4382-a286-332f51f3ab25 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.753433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459edc18-77e1-43fb-a1c5-b098ef0fc3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.754263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459edc18-77e1-43fb-a1c5-b098ef0fc3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.754542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459edc18-77e1-43fb-a1c5-b098ef0fc3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.754809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459edc18-77e1-43fb-a1c5-b098ef0fc3e4 None admin] PATH_INFO: `/v3/projects/deda1608daf440219c96aceb1e7ad22c` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.755991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459edc18-77e1-43fb-a1c5-b098ef0fc3e4 None admin] RBAC: Authorizing `identity:get_project(project_id=deda1608daf440219c96aceb1e7ad22c)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.757417 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459edc18-77e1-43fb-a1c5-b098ef0fc3e4 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.759325 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 526/1058] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:55 2022] GET /identity/v3/projects/deda1608daf440219c96aceb1e7ad22c => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:55.766320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc740bb-1014-4581-9b49-d144a8305873 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.866274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.876282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc740bb-1014-4581-9b49-d144a8305873 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.914257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3071d-782d-4175-9230-fcf1b66d5812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.914920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3071d-782d-4175-9230-fcf1b66d5812 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.915203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3071d-782d-4175-9230-fcf1b66d5812 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.915478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3071d-782d-4175-9230-fcf1b66d5812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.916305 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3071d-782d-4175-9230-fcf1b66d5812 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=deda1608daf440219c96aceb1e7ad22c, user.id=90770cf7321640949cf8155e6d093e53) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:55.916621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3071d-782d-4175-9230-fcf1b66d5812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.918714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3071d-782d-4175-9230-fcf1b66d5812 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.934171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 533/1059] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:55 2022] GET /identity/v3/role_assignments?user.id=90770cf7321640949cf8155e6d093e53&scope.project.id=deda1608daf440219c96aceb1e7ad22c&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:56.286446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3f66a-852f-404c-bd8b-c22bc72ad321 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.286787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3f66a-852f-404c-bd8b-c22bc72ad321 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.287045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3f66a-852f-404c-bd8b-c22bc72ad321 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.288879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 527/1060] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:56.295140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d203d7-44e5-494d-b3c4-ff1f02a26782 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.295690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d203d7-44e5-494d-b3c4-ff1f02a26782 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.295690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d203d7-44e5-494d-b3c4-ff1f02a26782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.313752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a1d203d7-44e5-494d-b3c4-ff1f02a26782 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:56.315161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a1d203d7-44e5-494d-b3c4-ff1f02a26782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:56.343289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964038a-e8fa-466a-b728-4b459cd6b54d None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.343580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964038a-e8fa-466a-b728-4b459cd6b54d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.343848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964038a-e8fa-466a-b728-4b459cd6b54d None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.345219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 528/1061] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:56.350426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b17bf1-a307-4cf4-aac4-01629185288b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.350718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b17bf1-a307-4cf4-aac4-01629185288b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.350998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b17bf1-a307-4cf4-aac4-01629185288b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.369836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c6b17bf1-a307-4cf4-aac4-01629185288b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:56.371070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c6b17bf1-a307-4cf4-aac4-01629185288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:56.396416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 534/1062] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:56.420196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d203d7-44e5-494d-b3c4-ff1f02a26782 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.447894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 529/1063] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:42:56.471722 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b17bf1-a307-4cf4-aac4-01629185288b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.508267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:56.524156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d203d7-44e5-494d-b3c4-ff1f02a26782 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:56.559657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7afd85-829a-4925-91a6-330d40a286a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:56.560231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7afd85-829a-4925-91a6-330d40a286a7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.560511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7afd85-829a-4925-91a6-330d40a286a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.560776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7afd85-829a-4925-91a6-330d40a286a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.569984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:56.582011 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b17bf1-a307-4cf4-aac4-01629185288b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:56.627199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc4c6a-2cca-4edd-9337-8a008bb5d8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:56.628021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4c6a-2cca-4edd-9337-8a008bb5d8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.628301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4c6a-2cca-4edd-9337-8a008bb5d8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.628572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4c6a-2cca-4edd-9337-8a008bb5d8c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.635680 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7afd85-829a-4925-91a6-330d40a286a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:56.637814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7afd85-829a-4925-91a6-330d40a286a7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:56.639921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc4c6a-2cca-4edd-9337-8a008bb5d8c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-b9cc4c6a-2cca-4edd-9337-8a008bb5d8c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:56.648316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:56.649280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:56.650361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 530/1064] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:56.656312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc4c6a-2cca-4edd-9337-8a008bb5d8c3 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.741307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:56.760379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 535/1065] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:42:56.767215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7afd85-829a-4925-91a6-330d40a286a7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.771445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc4c6a-2cca-4edd-9337-8a008bb5d8c3 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:56.806997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a686790-07b6-4726-a8c6-af0114f38c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:56.807814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a686790-07b6-4726-a8c6-af0114f38c0f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.807927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a686790-07b6-4726-a8c6-af0114f38c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.808193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a686790-07b6-4726-a8c6-af0114f38c0f None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.808989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a686790-07b6-4726-a8c6-af0114f38c0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:56.809847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a686790-07b6-4726-a8c6-af0114f38c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:56.811219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a686790-07b6-4726-a8c6-af0114f38c0f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:56.824711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 531/1066] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:56.825833 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a686790-07b6-4726-a8c6-af0114f38c0f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.842320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:56.875897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7afd85-829a-4925-91a6-330d40a286a7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:56.914572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f946d7-f8bb-433e-abca-103ab13d1f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:56.915367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f946d7-f8bb-433e-abca-103ab13d1f2f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.915643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f946d7-f8bb-433e-abca-103ab13d1f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.915911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f946d7-f8bb-433e-abca-103ab13d1f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.926557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f946d7-f8bb-433e-abca-103ab13d1f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:56.927997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f946d7-f8bb-433e-abca-103ab13d1f2f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:56.937723 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a686790-07b6-4726-a8c6-af0114f38c0f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-46f946d7-f8bb-433e-abca-103ab13d1f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:56.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:56.948106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:56.949006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:56.949006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:56.949006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:56.949006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:56.949006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 536/1067] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:56.956953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f946d7-f8bb-433e-abca-103ab13d1f2f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.979791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae0864-29e7-4a7f-b6e3-2064b35cabe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:56.981176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae0864-29e7-4a7f-b6e3-2064b35cabe6 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.981459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae0864-29e7-4a7f-b6e3-2064b35cabe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.981729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae0864-29e7-4a7f-b6e3-2064b35cabe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.993875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae0864-29e7-4a7f-b6e3-2064b35cabe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:56.995362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae0864-29e7-4a7f-b6e3-2064b35cabe6 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.004117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-15ae0864-29e7-4a7f-b6e3-2064b35cabe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:57.016467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:57.017438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:57.018371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:57.018371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:57.018371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:57.018371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:57.018371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 532/1068] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:57.023541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae0864-29e7-4a7f-b6e3-2064b35cabe6 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:57.075819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f946d7-f8bb-433e-abca-103ab13d1f2f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.091391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:57.116204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199be7eb-e8e1-4258-8024-501b1b070794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.116873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be7eb-e8e1-4258-8024-501b1b070794 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.117157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be7eb-e8e1-4258-8024-501b1b070794 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.117426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be7eb-e8e1-4258-8024-501b1b070794 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.118193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199be7eb-e8e1-4258-8024-501b1b070794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:57.118497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199be7eb-e8e1-4258-8024-501b1b070794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:57.119866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199be7eb-e8e1-4258-8024-501b1b070794 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.132733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 537/1069] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:57.135432 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae0864-29e7-4a7f-b6e3-2064b35cabe6 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.177217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1aead-89c8-4998-b79f-426739fd9ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.177912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1aead-89c8-4998-b79f-426739fd9ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.178206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1aead-89c8-4998-b79f-426739fd9ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.178482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1aead-89c8-4998-b79f-426739fd9ca8 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.179211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1aead-89c8-4998-b79f-426739fd9ca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:57.179520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1aead-89c8-4998-b79f-426739fd9ca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:57.180923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1aead-89c8-4998-b79f-426739fd9ca8 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.200641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 533/1070] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:57.202261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199be7eb-e8e1-4258-8024-501b1b070794 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:57.314202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:57.321245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199be7eb-e8e1-4258-8024-501b1b070794 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.357758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ffb52-aee8-4147-9c7f-f459f2038954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.358671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ffb52-aee8-4147-9c7f-f459f2038954 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.359063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ffb52-aee8-4147-9c7f-f459f2038954 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.359370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ffb52-aee8-4147-9c7f-f459f2038954 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.367624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ffb52-aee8-4147-9c7f-f459f2038954 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:57.369081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ffb52-aee8-4147-9c7f-f459f2038954 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b94ffb52-aee8-4147-9c7f-f459f2038954 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:42:57.384393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:57.385343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:57.386364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:57.386364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:57.386364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:42:57.386364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:42:57.386364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:42:57.386364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:42:57.386364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:42:57.386364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:42:57.386364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:42:57.386364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:57.386364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 538/1071] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Jun 16 14:42:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:57.392431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1aead-89c8-4998-b79f-426739fd9ca8 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:57.501249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1aead-89c8-4998-b79f-426739fd9ca8 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.524834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:57.535991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d40ee-89c4-4fb4-8ac9-68fa7644be95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.536666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d40ee-89c4-4fb4-8ac9-68fa7644be95 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.536948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d40ee-89c4-4fb4-8ac9-68fa7644be95 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.537223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d40ee-89c4-4fb4-8ac9-68fa7644be95 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.538091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d40ee-89c4-4fb4-8ac9-68fa7644be95 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:57.538402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d40ee-89c4-4fb4-8ac9-68fa7644be95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:57.539822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d40ee-89c4-4fb4-8ac9-68fa7644be95 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.557505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 534/1072] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Jun 16 14:42:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:57.563936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ffb52-aee8-4147-9c7f-f459f2038954 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:57.667219 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ffb52-aee8-4147-9c7f-f459f2038954 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.701356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e5276-812d-463f-bddd-c1d5fb26ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.702198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e5276-812d-463f-bddd-c1d5fb26ea90 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.702506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e5276-812d-463f-bddd-c1d5fb26ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.702791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e5276-812d-463f-bddd-c1d5fb26ea90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.714378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e5276-812d-463f-bddd-c1d5fb26ea90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:57.715967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e5276-812d-463f-bddd-c1d5fb26ea90 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3b6e5276-812d-463f-bddd-c1d5fb26ea90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:57.732720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:57.733687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:57.734607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:57.734607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:57.734607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:57.734607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:57.734607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 539/1073] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:57.739739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d40ee-89c4-4fb4-8ac9-68fa7644be95 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:57.838800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d40ee-89c4-4fb4-8ac9-68fa7644be95 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.874685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6c8f6-ab44-423a-aa09-1284d7a42a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.875352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6c8f6-ab44-423a-aa09-1284d7a42a79 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.875629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6c8f6-ab44-423a-aa09-1284d7a42a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.875901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6c8f6-ab44-423a-aa09-1284d7a42a79 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.876610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6c8f6-ab44-423a-aa09-1284d7a42a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:57.876925 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6c8f6-ab44-423a-aa09-1284d7a42a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:57.878322 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6c8f6-ab44-423a-aa09-1284d7a42a79 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.890309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 535/1074] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:57.896072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e5276-812d-463f-bddd-c1d5fb26ea90 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:57.909454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:57.998210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e5276-812d-463f-bddd-c1d5fb26ea90 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:58.034714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895cfce-49dc-4627-b289-7dd731a4d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:58.035508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895cfce-49dc-4627-b289-7dd731a4d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.035786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895cfce-49dc-4627-b289-7dd731a4d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.036057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895cfce-49dc-4627-b289-7dd731a4d4f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.042702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895cfce-49dc-4627-b289-7dd731a4d4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:58.044858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895cfce-49dc-4627-b289-7dd731a4d4f8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3895cfce-49dc-4627-b289-7dd731a4d4f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:42:58.059414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:58.061082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:58.062502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:42:58.062502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:42:58.062502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:42:58.062502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:42:58.062502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:42:58.062502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:42:58.062502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:42:58.062502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:42:58.062502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 540/1075] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:58.063621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b5b6-2356-4558-8a34-71fc589e3e26 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.063621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b5b6-2356-4558-8a34-71fc589e3e26 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.063897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b5b6-2356-4558-8a34-71fc589e3e26 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.065442 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 536/1076] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:42:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:58.066383 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895cfce-49dc-4627-b289-7dd731a4d4f8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:58.070500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097510c-1ae6-4700-b503-591c5d3774fb None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.070852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097510c-1ae6-4700-b503-591c5d3774fb None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.071208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097510c-1ae6-4700-b503-591c5d3774fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.087418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3097510c-1ae6-4700-b503-591c5d3774fb None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:58.088583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3097510c-1ae6-4700-b503-591c5d3774fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:58.125575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:58.140267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:58.160570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 537/1077] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:42:58.170473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895cfce-49dc-4627-b289-7dd731a4d4f8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:58.184750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097510c-1ae6-4700-b503-591c5d3774fb None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:58.204811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d522e-deab-4779-96f3-06a7ffcfabbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:58.205468 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d522e-deab-4779-96f3-06a7ffcfabbd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.205748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d522e-deab-4779-96f3-06a7ffcfabbd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.206051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d522e-deab-4779-96f3-06a7ffcfabbd None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.206823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d522e-deab-4779-96f3-06a7ffcfabbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:58.207126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d522e-deab-4779-96f3-06a7ffcfabbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:58.208533 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d522e-deab-4779-96f3-06a7ffcfabbd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:58.219742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 541/1078] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:42:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:58.225639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d522e-deab-4779-96f3-06a7ffcfabbd None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:58.288378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097510c-1ae6-4700-b503-591c5d3774fb None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:58.322552 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da120ab-1454-48a9-b09e-fe0b57280e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:58.323375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da120ab-1454-48a9-b09e-fe0b57280e84 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.323659 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da120ab-1454-48a9-b09e-fe0b57280e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.323936 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da120ab-1454-48a9-b09e-fe0b57280e84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.327571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d522e-deab-4779-96f3-06a7ffcfabbd None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:58.336607 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da120ab-1454-48a9-b09e-fe0b57280e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-4da120ab-1454-48a9-b09e-fe0b57280e84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:58.344885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:58.346064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:42:58.347094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 538/1079] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:58.352078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da120ab-1454-48a9-b09e-fe0b57280e84 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:58.359495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:58.367159 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de059ba-5206-4876-ae53-b5a8837a1bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:58.368056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de059ba-5206-4876-ae53-b5a8837a1bbe None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.368504 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de059ba-5206-4876-ae53-b5a8837a1bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.368683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de059ba-5206-4876-ae53-b5a8837a1bbe None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/f2faa046b0294a0ba1090be84bb1cebc/roles/c88603395e0444799ae7807bcb6a3ffe` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.371767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de059ba-5206-4876-ae53-b5a8837a1bbe None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=f2faa046b0294a0ba1090be84bb1cebc, role_id=c88603395e0444799ae7807bcb6a3ffe)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:58.373237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de059ba-5206-4876-ae53-b5a8837a1bbe None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:58.387871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 542/1080] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:58 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/f2faa046b0294a0ba1090be84bb1cebc/roles/c88603395e0444799ae7807bcb6a3ffe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:42:58.398366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:58.465610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da120ab-1454-48a9-b09e-fe0b57280e84 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:58.501036 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d4d05-7871-4ec3-b7e2-cc76aa77a97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:58.501733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d4d05-7871-4ec3-b7e2-cc76aa77a97e None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.502046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d4d05-7871-4ec3-b7e2-cc76aa77a97e None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.502322 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d4d05-7871-4ec3-b7e2-cc76aa77a97e None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.503081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d4d05-7871-4ec3-b7e2-cc76aa77a97e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:58.503385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d4d05-7871-4ec3-b7e2-cc76aa77a97e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:58.504783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d4d05-7871-4ec3-b7e2-cc76aa77a97e None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:58.515568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 539/1081] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:58.521265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de059ba-5206-4876-ae53-b5a8837a1bbe None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:58.632345 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de059ba-5206-4876-ae53-b5a8837a1bbe None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:58.669129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fed8fc-5f61-4a6a-8a5e-01c19c436171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:58.670047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fed8fc-5f61-4a6a-8a5e-01c19c436171 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.670331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fed8fc-5f61-4a6a-8a5e-01c19c436171 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.670652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fed8fc-5f61-4a6a-8a5e-01c19c436171 None admin] PATH_INFO: `/v3/users/90770cf7321640949cf8155e6d093e53` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.672183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fed8fc-5f61-4a6a-8a5e-01c19c436171 None admin] RBAC: Authorizing `identity:get_user(user_id=90770cf7321640949cf8155e6d093e53)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:58.673723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fed8fc-5f61-4a6a-8a5e-01c19c436171 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:58.675416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 543/1082] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:58 2022] GET /identity/v3/users/90770cf7321640949cf8155e6d093e53 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:58.681057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d4d05-7871-4ec3-b7e2-cc76aa77a97e None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:58.774183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:58.782115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d4d05-7871-4ec3-b7e2-cc76aa77a97e None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:58.815785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496e6fa-b219-4481-97a0-3441163bd7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:58.816643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496e6fa-b219-4481-97a0-3441163bd7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.816919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496e6fa-b219-4481-97a0-3441163bd7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.817187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496e6fa-b219-4481-97a0-3441163bd7c8 None admin] PATH_INFO: `/v3/projects/deda1608daf440219c96aceb1e7ad22c` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.818381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496e6fa-b219-4481-97a0-3441163bd7c8 None admin] RBAC: Authorizing `identity:get_project(project_id=deda1608daf440219c96aceb1e7ad22c)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:58.819804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496e6fa-b219-4481-97a0-3441163bd7c8 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:58.821488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 540/1083] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:58 2022] GET /identity/v3/projects/deda1608daf440219c96aceb1e7ad22c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:58.828830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fed8fc-5f61-4a6a-8a5e-01c19c436171 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:58.887368 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:58.929763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fed8fc-5f61-4a6a-8a5e-01c19c436171 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:58.962450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a773afd-94d4-4a5c-99d4-fc7ef1d375f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:58.963333 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a773afd-94d4-4a5c-99d4-fc7ef1d375f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.963613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a773afd-94d4-4a5c-99d4-fc7ef1d375f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.963885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a773afd-94d4-4a5c-99d4-fc7ef1d375f1 None admin] PATH_INFO: `/v3/projects/deda1608daf440219c96aceb1e7ad22c/users/90770cf7321640949cf8155e6d093e53/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.966510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a773afd-94d4-4a5c-99d4-fc7ef1d375f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=deda1608daf440219c96aceb1e7ad22c, user_id=90770cf7321640949cf8155e6d093e53, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:58.967925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a773afd-94d4-4a5c-99d4-fc7ef1d375f1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:58.981251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 544/1084] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:58 2022] PUT /identity/v3/projects/deda1608daf440219c96aceb1e7ad22c/users/90770cf7321640949cf8155e6d093e53/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:00.517053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900630ad-e7ec-41cb-8e0b-1ae1da382a8d None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.517617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900630ad-e7ec-41cb-8e0b-1ae1da382a8d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.517617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900630ad-e7ec-41cb-8e0b-1ae1da382a8d None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.519166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 541/1085] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:00.524167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb971cd-0a6b-4090-b076-ee1c0c263ba8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.524601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb971cd-0a6b-4090-b076-ee1c0c263ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.524726 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb971cd-0a6b-4090-b076-ee1c0c263ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.543295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1bb971cd-0a6b-4090-b076-ee1c0c263ba8 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:00.544690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1bb971cd-0a6b-4090-b076-ee1c0c263ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:00.612112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 545/1086] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:43:00.635277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900630ad-e7ec-41cb-8e0b-1ae1da382a8d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.741973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900630ad-e7ec-41cb-8e0b-1ae1da382a8d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.775927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136caa0-f3e2-417c-9cc1-cc8f432dfee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.776655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136caa0-f3e2-417c-9cc1-cc8f432dfee4 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.776935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136caa0-f3e2-417c-9cc1-cc8f432dfee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.777815 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136caa0-f3e2-417c-9cc1-cc8f432dfee4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.788068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136caa0-f3e2-417c-9cc1-cc8f432dfee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-e136caa0-f3e2-417c-9cc1-cc8f432dfee4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:00.796253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:00.797421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:43:00.798640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:43:00.802099 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 542/1087] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:00.803411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb971cd-0a6b-4090-b076-ee1c0c263ba8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.851659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.903057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb971cd-0a6b-4090-b076-ee1c0c263ba8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.936517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198815b-e1b3-4dcd-a6f9-da074885d952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.937179 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198815b-e1b3-4dcd-a6f9-da074885d952 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.937461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198815b-e1b3-4dcd-a6f9-da074885d952 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.937737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198815b-e1b3-4dcd-a6f9-da074885d952 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.938507 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198815b-e1b3-4dcd-a6f9-da074885d952 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:00.938818 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198815b-e1b3-4dcd-a6f9-da074885d952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.940183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198815b-e1b3-4dcd-a6f9-da074885d952 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.948447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 546/1088] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:00.954347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136caa0-f3e2-417c-9cc1-cc8f432dfee4 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.979628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.059873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136caa0-f3e2-417c-9cc1-cc8f432dfee4 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.096335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b061a-9944-453f-aeb6-8693e0cd543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.097143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b061a-9944-453f-aeb6-8693e0cd543d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.097426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b061a-9944-453f-aeb6-8693e0cd543d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.097704 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b061a-9944-453f-aeb6-8693e0cd543d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.109592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b061a-9944-453f-aeb6-8693e0cd543d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.111171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b061a-9944-453f-aeb6-8693e0cd543d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.122297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95f91-dd38-4e81-a969-ccba749ae901 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.122597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95f91-dd38-4e81-a969-ccba749ae901 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.122867 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95f91-dd38-4e81-a969-ccba749ae901 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.124258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 547/1089] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-0e9b061a-9944-453f-aeb6-8693e0cd543d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:01.128541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:01.129601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:01.130589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:01.130589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:01.130589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:01.130589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:43:01.130830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fbac-c4c4-4459-9e7f-3b5b2f115e39 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.130830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fbac-c4c4-4459-9e7f-3b5b2f115e39 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.130961 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 543/1090] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:01.131244 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fbac-c4c4-4459-9e7f-3b5b2f115e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.135247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b061a-9944-453f-aeb6-8693e0cd543d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.149770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2c10fbac-c4c4-4459-9e7f-3b5b2f115e39 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:01.151019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2c10fbac-c4c4-4459-9e7f-3b5b2f115e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:01.212400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.220941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 548/1091] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:43:01.238589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b061a-9944-453f-aeb6-8693e0cd543d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.243876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10fbac-c4c4-4459-9e7f-3b5b2f115e39 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.273709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced06e1-6ee1-4c8c-ad15-7cac13ba2326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.274531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced06e1-6ee1-4c8c-ad15-7cac13ba2326 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.274926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced06e1-6ee1-4c8c-ad15-7cac13ba2326 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.275286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced06e1-6ee1-4c8c-ad15-7cac13ba2326 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.276201 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced06e1-6ee1-4c8c-ad15-7cac13ba2326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:01.276555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced06e1-6ee1-4c8c-ad15-7cac13ba2326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.279041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced06e1-6ee1-4c8c-ad15-7cac13ba2326 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.287294 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.292246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 544/1092] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:01.298351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced06e1-6ee1-4c8c-ad15-7cac13ba2326 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.349687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10fbac-c4c4-4459-9e7f-3b5b2f115e39 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.383629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d2410-b998-4fb6-a3b6-63076d0e5b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.384417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d2410-b998-4fb6-a3b6-63076d0e5b6e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.384785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d2410-b998-4fb6-a3b6-63076d0e5b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.385059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d2410-b998-4fb6-a3b6-63076d0e5b6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.396460 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d2410-b998-4fb6-a3b6-63076d0e5b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:01.397141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced06e1-6ee1-4c8c-ad15-7cac13ba2326 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-fe3d2410-b998-4fb6-a3b6-63076d0e5b6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:01.404350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:01.405322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:43:01.406188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 549/1093] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:01.411591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d2410-b998-4fb6-a3b6-63076d0e5b6e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.434585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978251c-6bf8-4c23-afe4-2c283a2371e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.435436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978251c-6bf8-4c23-afe4-2c283a2371e1 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.435720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978251c-6bf8-4c23-afe4-2c283a2371e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.435997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978251c-6bf8-4c23-afe4-2c283a2371e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.438049 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.444583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978251c-6bf8-4c23-afe4-2c283a2371e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.446061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978251c-6bf8-4c23-afe4-2c283a2371e1 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-d978251c-6bf8-4c23-afe4-2c283a2371e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:01.462622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:01.463686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:01.464666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:01.464666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:01.464666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:01.464666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:01.464666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:01.464666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:01.464666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:01.464666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:01.464666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:01.464666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:43:01.464666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 545/1094] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:01.469899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978251c-6bf8-4c23-afe4-2c283a2371e1 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.520783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.523753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d2410-b998-4fb6-a3b6-63076d0e5b6e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.558122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a54ca-8a57-45e2-97ab-015fe2d76f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.559882 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a54ca-8a57-45e2-97ab-015fe2d76f72 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.560184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a54ca-8a57-45e2-97ab-015fe2d76f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.560452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a54ca-8a57-45e2-97ab-015fe2d76f72 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.561195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a54ca-8a57-45e2-97ab-015fe2d76f72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:01.561503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a54ca-8a57-45e2-97ab-015fe2d76f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.562896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a54ca-8a57-45e2-97ab-015fe2d76f72 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.570880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 550/1095] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:01.571780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978251c-6bf8-4c23-afe4-2c283a2371e1 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.578080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a54ca-8a57-45e2-97ab-015fe2d76f72 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.607598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d7f8-38f0-42d5-bf6f-9a9d56c2f634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.608425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d7f8-38f0-42d5-bf6f-9a9d56c2f634 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.608706 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d7f8-38f0-42d5-bf6f-9a9d56c2f634 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.608984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d7f8-38f0-42d5-bf6f-9a9d56c2f634 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.609815 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474d7f8-38f0-42d5-bf6f-9a9d56c2f634 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:01.610155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474d7f8-38f0-42d5-bf6f-9a9d56c2f634 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.611586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474d7f8-38f0-42d5-bf6f-9a9d56c2f634 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.629154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 546/1096] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:01.634913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d7f8-38f0-42d5-bf6f-9a9d56c2f634 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.681434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a54ca-8a57-45e2-97ab-015fe2d76f72 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.690763 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.714385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1dc6a-80f9-4fa5-97e0-d8b3d3b74dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.715990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1dc6a-80f9-4fa5-97e0-d8b3d3b74dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.716265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1dc6a-80f9-4fa5-97e0-d8b3d3b74dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.716532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1dc6a-80f9-4fa5-97e0-d8b3d3b74dc4 None admin] PATH_INFO: `/v3/users/90770cf7321640949cf8155e6d093e53` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.717739 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1dc6a-80f9-4fa5-97e0-d8b3d3b74dc4 None admin] RBAC: Authorizing `identity:get_user(user_id=90770cf7321640949cf8155e6d093e53)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.719210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1dc6a-80f9-4fa5-97e0-d8b3d3b74dc4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.721067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 551/1097] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/users/90770cf7321640949cf8155e6d093e53 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:01.726793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1dc6a-80f9-4fa5-97e0-d8b3d3b74dc4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.741230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d7f8-38f0-42d5-bf6f-9a9d56c2f634 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.757391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.774726 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860ee99-eda8-405c-9512-83e4c84de11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.775374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860ee99-eda8-405c-9512-83e4c84de11a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.775651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860ee99-eda8-405c-9512-83e4c84de11a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.775924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860ee99-eda8-405c-9512-83e4c84de11a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.827682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1dc6a-80f9-4fa5-97e0-d8b3d3b74dc4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.842853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860ee99-eda8-405c-9512-83e4c84de11a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.844480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860ee99-eda8-405c-9512-83e4c84de11a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.862225 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e4dc6-7f95-462e-8968-95a1289d7c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.862802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4dc6-7f95-462e-8968-95a1289d7c6b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.863083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4dc6-7f95-462e-8968-95a1289d7c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.863358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4dc6-7f95-462e-8968-95a1289d7c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.896517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.933313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e4dc6-7f95-462e-8968-95a1289d7c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.934809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e4dc6-7f95-462e-8968-95a1289d7c6b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.946338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 547/1098] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:43:01.952278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860ee99-eda8-405c-9512-83e4c84de11a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.963190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.036055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 552/1099] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:43:02.042034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e4dc6-7f95-462e-8968-95a1289d7c6b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.053142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860ee99-eda8-405c-9512-83e4c84de11a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.086495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2153597-42ef-490f-ac43-7e0e891b13ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.087283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153597-42ef-490f-ac43-7e0e891b13ab None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.087561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153597-42ef-490f-ac43-7e0e891b13ab None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.087833 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153597-42ef-490f-ac43-7e0e891b13ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.098442 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2153597-42ef-490f-ac43-7e0e891b13ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.099873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2153597-42ef-490f-ac43-7e0e891b13ab None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-d2153597-42ef-490f-ac43-7e0e891b13ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:02.117571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:02.118520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:02.119599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:02.119599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:02.119599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:02.119599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:43:02.119599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 548/1100] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:02.124368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2153597-42ef-490f-ac43-7e0e891b13ab None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.127861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.139660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e4dc6-7f95-462e-8968-95a1289d7c6b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.168337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.174392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a984298-b7dc-4cf6-8b2f-80960972a40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.175246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a984298-b7dc-4cf6-8b2f-80960972a40c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.175521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a984298-b7dc-4cf6-8b2f-80960972a40c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.175796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a984298-b7dc-4cf6-8b2f-80960972a40c None admin] PATH_INFO: `/v3/projects/deda1608daf440219c96aceb1e7ad22c` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.176949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a984298-b7dc-4cf6-8b2f-80960972a40c None admin] RBAC: Authorizing `identity:get_project(project_id=deda1608daf440219c96aceb1e7ad22c)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.178402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a984298-b7dc-4cf6-8b2f-80960972a40c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.180275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 553/1101] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/projects/deda1608daf440219c96aceb1e7ad22c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:02.186515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a984298-b7dc-4cf6-8b2f-80960972a40c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.232131 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2153597-42ef-490f-ac43-7e0e891b13ab None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.267161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec2ff8-2757-4b02-8340-6acb2d62d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.267854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2ff8-2757-4b02-8340-6acb2d62d7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.268168 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2ff8-2757-4b02-8340-6acb2d62d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.268468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2ff8-2757-4b02-8340-6acb2d62d7d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.269248 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec2ff8-2757-4b02-8340-6acb2d62d7d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:02.269556 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec2ff8-2757-4b02-8340-6acb2d62d7d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.270974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec2ff8-2757-4b02-8340-6acb2d62d7d6 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.284881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 549/1102] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:02.290051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a984298-b7dc-4cf6-8b2f-80960972a40c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.290459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec2ff8-2757-4b02-8340-6acb2d62d7d6 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.329377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcb68b-cb28-4b25-887b-ee9b39f7dfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.330140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb68b-cb28-4b25-887b-ee9b39f7dfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.330424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb68b-cb28-4b25-887b-ee9b39f7dfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.330697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb68b-cb28-4b25-887b-ee9b39f7dfc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.331522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcb68b-cb28-4b25-887b-ee9b39f7dfc9 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=deda1608daf440219c96aceb1e7ad22c, user.id=90770cf7321640949cf8155e6d093e53) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:02.331833 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcb68b-cb28-4b25-887b-ee9b39f7dfc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.333246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcb68b-cb28-4b25-887b-ee9b39f7dfc9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.339017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 554/1103] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/role_assignments?user.id=90770cf7321640949cf8155e6d093e53&scope.project.id=deda1608daf440219c96aceb1e7ad22c&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:02.353599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.396470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec2ff8-2757-4b02-8340-6acb2d62d7d6 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.434764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652d069-48a1-427b-8739-abef43c6f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.435842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652d069-48a1-427b-8739-abef43c6f184 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.436312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652d069-48a1-427b-8739-abef43c6f184 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.436583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652d069-48a1-427b-8739-abef43c6f184 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.444017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652d069-48a1-427b-8739-abef43c6f184 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.445482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652d069-48a1-427b-8739-abef43c6f184 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-8652d069-48a1-427b-8739-abef43c6f184 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:02.461562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:02.462775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:02.464075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:02.464075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:02.464075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:02.464075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:02.464075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:02.464075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:02.464075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:02.464075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:43:02.464075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 550/1104] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:02.469142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcb68b-cb28-4b25-887b-ee9b39f7dfc9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.537530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.577652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcb68b-cb28-4b25-887b-ee9b39f7dfc9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.610300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848e89c-4188-4af3-92d6-c36916ace587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.611013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848e89c-4188-4af3-92d6-c36916ace587 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.611359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848e89c-4188-4af3-92d6-c36916ace587 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.611633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848e89c-4188-4af3-92d6-c36916ace587 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.612405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848e89c-4188-4af3-92d6-c36916ace587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:02.612711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848e89c-4188-4af3-92d6-c36916ace587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.614137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848e89c-4188-4af3-92d6-c36916ace587 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.626765 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 555/1105] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:02.632730 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652d069-48a1-427b-8739-abef43c6f184 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.736674 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652d069-48a1-427b-8739-abef43c6f184 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.760255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.772434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fc45b-e6b6-4192-8b66-2d2db51a851c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.773092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fc45b-e6b6-4192-8b66-2d2db51a851c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.773371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fc45b-e6b6-4192-8b66-2d2db51a851c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.773679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fc45b-e6b6-4192-8b66-2d2db51a851c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.774565 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fc45b-e6b6-4192-8b66-2d2db51a851c None admin] RBAC: Adding query filter params (role.id=c88603395e0444799ae7807bcb6a3ffe, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=f2faa046b0294a0ba1090be84bb1cebc) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:02.774877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fc45b-e6b6-4192-8b66-2d2db51a851c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.776295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fc45b-e6b6-4192-8b66-2d2db51a851c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.782461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 551/1106] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/role_assignments?user.id=f2faa046b0294a0ba1090be84bb1cebc&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=c88603395e0444799ae7807bcb6a3ffe => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:04.502408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315e09-0fdf-43b3-bd82-7f6bdced5275 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.502985 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315e09-0fdf-43b3-bd82-7f6bdced5275 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.502985 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315e09-0fdf-43b3-bd82-7f6bdced5275 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.504318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 556/1107] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:04.509445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc8c6-0172-48c0-89cc-285e4062af58 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.509837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc8c6-0172-48c0-89cc-285e4062af58 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.510030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc8c6-0172-48c0-89cc-285e4062af58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.527360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-dcbfc8c6-0172-48c0-89cc-285e4062af58 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:04.528545 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-dcbfc8c6-0172-48c0-89cc-285e4062af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:04.595580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 552/1108] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:04.619817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27315e09-0fdf-43b3-bd82-7f6bdced5275 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.719004 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27315e09-0fdf-43b3-bd82-7f6bdced5275 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.740640 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:04.753096 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73797c8a-d94b-405f-ae45-a33c63017fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.753814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73797c8a-d94b-405f-ae45-a33c63017fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.754119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73797c8a-d94b-405f-ae45-a33c63017fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.754389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73797c8a-d94b-405f-ae45-a33c63017fa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.755538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73797c8a-d94b-405f-ae45-a33c63017fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:04.756949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73797c8a-d94b-405f-ae45-a33c63017fa7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:04.758573 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 557/1109] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:04.764608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfc8c6-0172-48c0-89cc-285e4062af58 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.865311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfc8c6-0172-48c0-89cc-285e4062af58 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.882784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:04.900456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc9b42-5d2f-4108-ba22-594c4d1a8396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.901126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc9b42-5d2f-4108-ba22-594c4d1a8396 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.901411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc9b42-5d2f-4108-ba22-594c4d1a8396 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.901687 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc9b42-5d2f-4108-ba22-594c4d1a8396 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.903492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc9b42-5d2f-4108-ba22-594c4d1a8396 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:04.904926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc9b42-5d2f-4108-ba22-594c4d1a8396 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:04.924957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 553/1110] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:04 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:07.057664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e025be7-df48-4a32-84f7-4f019cdba3f8 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.058221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e025be7-df48-4a32-84f7-4f019cdba3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.058221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e025be7-df48-4a32-84f7-4f019cdba3f8 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.060076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 558/1111] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:07.065436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495e003-7792-427b-b136-df49847af0d4 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.065864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495e003-7792-427b-b136-df49847af0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.066019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495e003-7792-427b-b136-df49847af0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.083011 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-2495e003-7792-427b-b136-df49847af0d4 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:07.084194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2495e003-7792-427b-b136-df49847af0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:07.156867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 554/1112] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:07.179934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e025be7-df48-4a32-84f7-4f019cdba3f8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:07.281084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e025be7-df48-4a32-84f7-4f019cdba3f8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.316536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fc9c6-e1ac-4196-ae63-4ed288e9a004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.317319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc9c6-e1ac-4196-ae63-4ed288e9a004 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.317600 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc9c6-e1ac-4196-ae63-4ed288e9a004 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.317873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc9c6-e1ac-4196-ae63-4ed288e9a004 None admin] PATH_INFO: `/v3/roles/ec1f98086b0748cf9d484264d6d60fff` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.319359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fc9c6-e1ac-4196-ae63-4ed288e9a004 None admin] RBAC: Authorizing `identity:get_role(role_id=ec1f98086b0748cf9d484264d6d60fff)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:07.320719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fc9c6-e1ac-4196-ae63-4ed288e9a004 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:07.322279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 559/1113] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:07 2022] GET /identity/v3/roles/ec1f98086b0748cf9d484264d6d60fff => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:07.328738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495e003-7792-427b-b136-df49847af0d4 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:07.424205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495e003-7792-427b-b136-df49847af0d4 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.426463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:07.459510 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253c7f6-e412-43ae-803f-9fdf927b4ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.460376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253c7f6-e412-43ae-803f-9fdf927b4ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.460658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253c7f6-e412-43ae-803f-9fdf927b4ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.460933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253c7f6-e412-43ae-803f-9fdf927b4ea5 None admin] PATH_INFO: `/v3/users/b55a4a5a1e334ab6bdb8d519eb4e59d6` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.474295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253c7f6-e412-43ae-803f-9fdf927b4ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=b55a4a5a1e334ab6bdb8d519eb4e59d6)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:07.475757 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253c7f6-e412-43ae-803f-9fdf927b4ea5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:07.477479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 555/1114] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:07 2022] GET /identity/v3/users/b55a4a5a1e334ab6bdb8d519eb4e59d6 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:07.484527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fc9c6-e1ac-4196-ae63-4ed288e9a004 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:07.541049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:07.583601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fc9c6-e1ac-4196-ae63-4ed288e9a004 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.616967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a2adc-6009-46c6-9a73-c10a606da0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.617601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a2adc-6009-46c6-9a73-c10a606da0fc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.617877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a2adc-6009-46c6-9a73-c10a606da0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.618176 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a2adc-6009-46c6-9a73-c10a606da0fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.684644 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a2adc-6009-46c6-9a73-c10a606da0fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:07.686107 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a2adc-6009-46c6-9a73-c10a606da0fc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:07.741101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:07.783223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 560/1115] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:43:07.789333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253c7f6-e412-43ae-803f-9fdf927b4ea5 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:07.890425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253c7f6-e412-43ae-803f-9fdf927b4ea5 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.923255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a18fde-9cb1-4ea6-b5a5-6aef7141e5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.924102 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a18fde-9cb1-4ea6-b5a5-6aef7141e5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.924384 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a18fde-9cb1-4ea6-b5a5-6aef7141e5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.924661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a18fde-9cb1-4ea6-b5a5-6aef7141e5d1 None admin] PATH_INFO: `/v3/projects/deda1608daf440219c96aceb1e7ad22c` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.925838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a18fde-9cb1-4ea6-b5a5-6aef7141e5d1 None admin] RBAC: Authorizing `identity:get_project(project_id=deda1608daf440219c96aceb1e7ad22c)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:07.927296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a18fde-9cb1-4ea6-b5a5-6aef7141e5d1 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:07.928983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 556/1116] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:07 2022] GET /identity/v3/projects/deda1608daf440219c96aceb1e7ad22c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:07.937151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a2adc-6009-46c6-9a73-c10a606da0fc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.036667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a2adc-6009-46c6-9a73-c10a606da0fc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:08.069632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef773028-1073-4b11-bfd1-51656b07d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:08.070318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773028-1073-4b11-bfd1-51656b07d941 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.070603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773028-1073-4b11-bfd1-51656b07d941 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.070878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773028-1073-4b11-bfd1-51656b07d941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.071700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef773028-1073-4b11-bfd1-51656b07d941 None admin] RBAC: Adding query filter params (role.id=ec1f98086b0748cf9d484264d6d60fff, scope.project.id=deda1608daf440219c96aceb1e7ad22c, user.id=b55a4a5a1e334ab6bdb8d519eb4e59d6) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:08.072013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef773028-1073-4b11-bfd1-51656b07d941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.073475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef773028-1073-4b11-bfd1-51656b07d941 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:08.079711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 561/1117] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:07 2022] GET /identity/v3/role_assignments?user.id=b55a4a5a1e334ab6bdb8d519eb4e59d6&scope.project.id=deda1608daf440219c96aceb1e7ad22c&role.id=ec1f98086b0748cf9d484264d6d60fff => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:10.236000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffbfa-bb06-43b2-a93e-34f4c8a543f8 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.236555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffbfa-bb06-43b2-a93e-34f4c8a543f8 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.236555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffbfa-bb06-43b2-a93e-34f4c8a543f8 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.237922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 557/1118] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:10.243137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62687568-5aee-45d5-ab22-3f37e7c17c42 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.243534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62687568-5aee-45d5-ab22-3f37e7c17c42 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.243686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62687568-5aee-45d5-ab22-3f37e7c17c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.260302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-62687568-5aee-45d5-ab22-3f37e7c17c42 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:10.262397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-62687568-5aee-45d5-ab22-3f37e7c17c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:10.278165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:10.332532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 562/1119] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:10.354816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ffbfa-bb06-43b2-a93e-34f4c8a543f8 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:10.385072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:10.458040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ffbfa-bb06-43b2-a93e-34f4c8a543f8 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:10.499886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560be133-6caa-4539-b409-f7f63ca36546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:10.500669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be133-6caa-4539-b409-f7f63ca36546 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.500943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be133-6caa-4539-b409-f7f63ca36546 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.501213 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be133-6caa-4539-b409-f7f63ca36546 None admin] PATH_INFO: `/v3/roles/ec1f98086b0748cf9d484264d6d60fff` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.502716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560be133-6caa-4539-b409-f7f63ca36546 None admin] RBAC: Authorizing `identity:get_role(role_id=ec1f98086b0748cf9d484264d6d60fff)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:10.504087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560be133-6caa-4539-b409-f7f63ca36546 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:10.505475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 558/1120] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:10 2022] GET /identity/v3/roles/ec1f98086b0748cf9d484264d6d60fff => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:10.511584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62687568-5aee-45d5-ab22-3f37e7c17c42 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:10.607777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62687568-5aee-45d5-ab22-3f37e7c17c42 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:10.641047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652eda5-ff37-4a6e-b9a2-9df3fc9546ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:10.641940 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652eda5-ff37-4a6e-b9a2-9df3fc9546ae None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.642227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652eda5-ff37-4a6e-b9a2-9df3fc9546ae None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.642501 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652eda5-ff37-4a6e-b9a2-9df3fc9546ae None admin] PATH_INFO: `/v3/users/b55a4a5a1e334ab6bdb8d519eb4e59d6` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.643691 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652eda5-ff37-4a6e-b9a2-9df3fc9546ae None admin] RBAC: Authorizing `identity:get_user(user_id=b55a4a5a1e334ab6bdb8d519eb4e59d6)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:10.645107 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652eda5-ff37-4a6e-b9a2-9df3fc9546ae None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:10.646761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 563/1121] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:10 2022] GET /identity/v3/users/b55a4a5a1e334ab6bdb8d519eb4e59d6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:10.652911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560be133-6caa-4539-b409-f7f63ca36546 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:10.748648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:10.752818 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560be133-6caa-4539-b409-f7f63ca36546 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:10.786089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbfc68-ca28-4987-a38f-bc8f059eaca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:10.786934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbfc68-ca28-4987-a38f-bc8f059eaca2 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.787211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbfc68-ca28-4987-a38f-bc8f059eaca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.787481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbfc68-ca28-4987-a38f-bc8f059eaca2 None admin] PATH_INFO: `/v3/projects/deda1608daf440219c96aceb1e7ad22c` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.788651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbfc68-ca28-4987-a38f-bc8f059eaca2 None admin] RBAC: Authorizing `identity:get_project(project_id=deda1608daf440219c96aceb1e7ad22c)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:10.790105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbfc68-ca28-4987-a38f-bc8f059eaca2 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:10.791786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 559/1122] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:10 2022] GET /identity/v3/projects/deda1608daf440219c96aceb1e7ad22c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:10.798436 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652eda5-ff37-4a6e-b9a2-9df3fc9546ae None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:10.819359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:10.900423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652eda5-ff37-4a6e-b9a2-9df3fc9546ae None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:10.934408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e023d-5deb-4b93-9a9c-3a94ba37c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:10.935292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e023d-5deb-4b93-9a9c-3a94ba37c323 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.935575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e023d-5deb-4b93-9a9c-3a94ba37c323 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.935841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e023d-5deb-4b93-9a9c-3a94ba37c323 None admin] PATH_INFO: `/v3/projects/deda1608daf440219c96aceb1e7ad22c/users/b55a4a5a1e334ab6bdb8d519eb4e59d6/roles/ec1f98086b0748cf9d484264d6d60fff` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.938049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e023d-5deb-4b93-9a9c-3a94ba37c323 None admin] RBAC: Authorizing `identity:create_grant(project_id=deda1608daf440219c96aceb1e7ad22c, user_id=b55a4a5a1e334ab6bdb8d519eb4e59d6, role_id=ec1f98086b0748cf9d484264d6d60fff)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:10.939464 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e023d-5deb-4b93-9a9c-3a94ba37c323 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:10.952080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 564/1123] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:10 2022] PUT /identity/v3/projects/deda1608daf440219c96aceb1e7ad22c/users/b55a4a5a1e334ab6bdb8d519eb4e59d6/roles/ec1f98086b0748cf9d484264d6d60fff => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:13.085311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8166409-e2a1-4019-b752-07fc5ad5f36c None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.085835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8166409-e2a1-4019-b752-07fc5ad5f36c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.085835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8166409-e2a1-4019-b752-07fc5ad5f36c None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.087177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 560/1124] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:13.093725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14056a-2519-4f42-bc53-cc25c2816433 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.094208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14056a-2519-4f42-bc53-cc25c2816433 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.094301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14056a-2519-4f42-bc53-cc25c2816433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.111907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3b14056a-2519-4f42-bc53-cc25c2816433 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:13.113106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3b14056a-2519-4f42-bc53-cc25c2816433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:13.181797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 565/1125] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:13.206633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8166409-e2a1-4019-b752-07fc5ad5f36c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.313654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8166409-e2a1-4019-b752-07fc5ad5f36c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.357042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccc8da-0d0f-40de-a3de-0d272b31638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.358470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc8da-0d0f-40de-a3de-0d272b31638a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.358931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc8da-0d0f-40de-a3de-0d272b31638a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.359498 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc8da-0d0f-40de-a3de-0d272b31638a None admin] PATH_INFO: `/v3/roles/ec1f98086b0748cf9d484264d6d60fff` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.361835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccc8da-0d0f-40de-a3de-0d272b31638a None admin] RBAC: Authorizing `identity:get_role(role_id=ec1f98086b0748cf9d484264d6d60fff)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.363246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccc8da-0d0f-40de-a3de-0d272b31638a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.364628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 561/1126] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/roles/ec1f98086b0748cf9d484264d6d60fff => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.370577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14056a-2519-4f42-bc53-cc25c2816433 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.382143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.480494 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14056a-2519-4f42-bc53-cc25c2816433 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.517176 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2513a8-ea14-4d84-9a07-b5607baa7563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.518074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2513a8-ea14-4d84-9a07-b5607baa7563 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.518354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2513a8-ea14-4d84-9a07-b5607baa7563 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.518620 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2513a8-ea14-4d84-9a07-b5607baa7563 None admin] PATH_INFO: `/v3/users/b55a4a5a1e334ab6bdb8d519eb4e59d6` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.519789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2513a8-ea14-4d84-9a07-b5607baa7563 None admin] RBAC: Authorizing `identity:get_user(user_id=b55a4a5a1e334ab6bdb8d519eb4e59d6)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.521209 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2513a8-ea14-4d84-9a07-b5607baa7563 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.523444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 566/1127] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/users/b55a4a5a1e334ab6bdb8d519eb4e59d6 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.531582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccc8da-0d0f-40de-a3de-0d272b31638a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.568889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.643159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccc8da-0d0f-40de-a3de-0d272b31638a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.682065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2cca1-fa57-4694-bcf9-f2ca27803e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.683798 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2cca1-fa57-4694-bcf9-f2ca27803e97 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.684076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2cca1-fa57-4694-bcf9-f2ca27803e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.684352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2cca1-fa57-4694-bcf9-f2ca27803e97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.757961 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2cca1-fa57-4694-bcf9-f2ca27803e97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.759412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2cca1-fa57-4694-bcf9-f2ca27803e97 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.795676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.860982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 562/1128] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:13.867147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2513a8-ea14-4d84-9a07-b5607baa7563 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.943585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.965065 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2513a8-ea14-4d84-9a07-b5607baa7563 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.999708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6888e-6f30-4b29-96b8-30f42c8cdb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.000569 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6888e-6f30-4b29-96b8-30f42c8cdb1c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.000853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6888e-6f30-4b29-96b8-30f42c8cdb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.001128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6888e-6f30-4b29-96b8-30f42c8cdb1c None admin] PATH_INFO: `/v3/projects/deda1608daf440219c96aceb1e7ad22c` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.002348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6888e-6f30-4b29-96b8-30f42c8cdb1c None admin] RBAC: Authorizing `identity:get_project(project_id=deda1608daf440219c96aceb1e7ad22c)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.003777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6888e-6f30-4b29-96b8-30f42c8cdb1c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.005478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 567/1129] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/projects/deda1608daf440219c96aceb1e7ad22c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:14.012734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2cca1-fa57-4694-bcf9-f2ca27803e97 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.109857 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2cca1-fa57-4694-bcf9-f2ca27803e97 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.143560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1b371-d4d1-4de3-bbc8-212671ab69d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.144203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b371-d4d1-4de3-bbc8-212671ab69d3 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.144481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b371-d4d1-4de3-bbc8-212671ab69d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.144751 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b371-d4d1-4de3-bbc8-212671ab69d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.145561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1b371-d4d1-4de3-bbc8-212671ab69d3 None admin] RBAC: Adding query filter params (role.id=ec1f98086b0748cf9d484264d6d60fff, scope.project.id=deda1608daf440219c96aceb1e7ad22c, user.id=b55a4a5a1e334ab6bdb8d519eb4e59d6) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:14.145868 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1b371-d4d1-4de3-bbc8-212671ab69d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.147309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1b371-d4d1-4de3-bbc8-212671ab69d3 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.149065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.154233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 563/1130] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/role_assignments?user.id=b55a4a5a1e334ab6bdb8d519eb4e59d6&scope.project.id=deda1608daf440219c96aceb1e7ad22c&role.id=ec1f98086b0748cf9d484264d6d60fff => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:16.363868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e288102-9753-4cbe-97f6-6ae8ccb90976 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.364408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e288102-9753-4cbe-97f6-6ae8ccb90976 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.364563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e288102-9753-4cbe-97f6-6ae8ccb90976 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.366084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 568/1131] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:16.372184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ef0f-8ac5-4d8e-a262-aa9fe21ea189 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.372630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ef0f-8ac5-4d8e-a262-aa9fe21ea189 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.372724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ef0f-8ac5-4d8e-a262-aa9fe21ea189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.390292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3556ef0f-8ac5-4d8e-a262-aa9fe21ea189 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:16.391490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3556ef0f-8ac5-4d8e-a262-aa9fe21ea189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:16.459258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 564/1132] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:16.484984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e288102-9753-4cbe-97f6-6ae8ccb90976 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.583933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e288102-9753-4cbe-97f6-6ae8ccb90976 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.616825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf35024-4405-44e6-baf8-c5bd151c4cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.617534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35024-4405-44e6-baf8-c5bd151c4cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.617811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35024-4405-44e6-baf8-c5bd151c4cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.618114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35024-4405-44e6-baf8-c5bd151c4cf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.619266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf35024-4405-44e6-baf8-c5bd151c4cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.621347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf35024-4405-44e6-baf8-c5bd151c4cf7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.622959 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 569/1133] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:16.628905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556ef0f-8ac5-4d8e-a262-aa9fe21ea189 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.725754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556ef0f-8ac5-4d8e-a262-aa9fe21ea189 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.752539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:16.760508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc4bf-fbc1-4780-911a-0120cbae5d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.761421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc4bf-fbc1-4780-911a-0120cbae5d8d None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.761709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc4bf-fbc1-4780-911a-0120cbae5d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.762275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc4bf-fbc1-4780-911a-0120cbae5d8d None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.762975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fc4bf-fbc1-4780-911a-0120cbae5d8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.764402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fc4bf-fbc1-4780-911a-0120cbae5d8d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.789234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 565/1134] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:43:16 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:18.946321 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45471b-5baf-40d4-9724-01908facdf1f None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.946858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45471b-5baf-40d4-9724-01908facdf1f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.946858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45471b-5baf-40d4-9724-01908facdf1f None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.948151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 570/1135] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:18.954841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585cdf-0b65-49d3-9a95-4a753383d7ce None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.955242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585cdf-0b65-49d3-9a95-4a753383d7ce None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.955402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585cdf-0b65-49d3-9a95-4a753383d7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.972501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ad585cdf-0b65-49d3-9a95-4a753383d7ce None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:18.973692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ad585cdf-0b65-49d3-9a95-4a753383d7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:19.040766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 566/1136] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:19.066314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45471b-5baf-40d4-9724-01908facdf1f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.083101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.169615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45471b-5baf-40d4-9724-01908facdf1f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.203744 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccc389-0dc8-458b-8cce-ed59528e33b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.204462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccc389-0dc8-458b-8cce-ed59528e33b3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.204742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccc389-0dc8-458b-8cce-ed59528e33b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.205015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccc389-0dc8-458b-8cce-ed59528e33b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.206187 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccc389-0dc8-458b-8cce-ed59528e33b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.207610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccc389-0dc8-458b-8cce-ed59528e33b3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.209257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 571/1137] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:19.215611 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad585cdf-0b65-49d3-9a95-4a753383d7ce None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.310849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad585cdf-0b65-49d3-9a95-4a753383d7ce None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.321220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.345282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecdac9-5473-4a21-bab3-882f5fb65764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.345979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecdac9-5473-4a21-bab3-882f5fb65764 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.346263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecdac9-5473-4a21-bab3-882f5fb65764 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.346537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecdac9-5473-4a21-bab3-882f5fb65764 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.347245 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecdac9-5473-4a21-bab3-882f5fb65764 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.348674 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecdac9-5473-4a21-bab3-882f5fb65764 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.367659 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 567/1138] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:19 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:43:21.527456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556fdf-a791-46f8-a151-41dca0012fb4 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.528014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556fdf-a791-46f8-a151-41dca0012fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.528014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556fdf-a791-46f8-a151-41dca0012fb4 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.529388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 572/1139] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:21.534690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9200-ab79-4e12-81a5-bbe8c9b29f7e None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.535067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9200-ab79-4e12-81a5-bbe8c9b29f7e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.535244 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9200-ab79-4e12-81a5-bbe8c9b29f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.552784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-0f3b9200-ab79-4e12-81a5-bbe8c9b29f7e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:21.554004 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0f3b9200-ab79-4e12-81a5-bbe8c9b29f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:21.620161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 568/1140] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:21.643720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a556fdf-a791-46f8-a151-41dca0012fb4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.724334 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.743139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a556fdf-a791-46f8-a151-41dca0012fb4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.775964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146ed7f-8502-46cd-941f-8b51a20bbf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.776860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146ed7f-8502-46cd-941f-8b51a20bbf99 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.777134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146ed7f-8502-46cd-941f-8b51a20bbf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.777402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146ed7f-8502-46cd-941f-8b51a20bbf99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.787270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146ed7f-8502-46cd-941f-8b51a20bbf99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-6146ed7f-8502-46cd-941f-8b51a20bbf99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:21.795439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:21.796524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:43:21.797678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 573/1141] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:21.802620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b9200-ab79-4e12-81a5-bbe8c9b29f7e None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.893970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.900295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b9200-ab79-4e12-81a5-bbe8c9b29f7e None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.934633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e44724-c4c5-438b-b750-5aa5e2fe961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.935293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e44724-c4c5-438b-b750-5aa5e2fe961a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.935571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e44724-c4c5-438b-b750-5aa5e2fe961a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.935841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e44724-c4c5-438b-b750-5aa5e2fe961a None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.936574 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e44724-c4c5-438b-b750-5aa5e2fe961a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:21.936876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e44724-c4c5-438b-b750-5aa5e2fe961a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.938271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e44724-c4c5-438b-b750-5aa5e2fe961a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.946185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 569/1142] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:21.952049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146ed7f-8502-46cd-941f-8b51a20bbf99 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.051827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146ed7f-8502-46cd-941f-8b51a20bbf99 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.084099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f24e3b-1a42-4ae5-89ee-4c95f4fc6eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.084961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24e3b-1a42-4ae5-89ee-4c95f4fc6eac None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.085241 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24e3b-1a42-4ae5-89ee-4c95f4fc6eac None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.085511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24e3b-1a42-4ae5-89ee-4c95f4fc6eac None admin] PATH_INFO: `/v3/users/15dcd39f74e649abae2963688922adc7` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.096930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.099802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f24e3b-1a42-4ae5-89ee-4c95f4fc6eac None admin] RBAC: Authorizing `identity:get_user(user_id=15dcd39f74e649abae2963688922adc7)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.101532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f24e3b-1a42-4ae5-89ee-4c95f4fc6eac None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.103358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 574/1143] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/users/15dcd39f74e649abae2963688922adc7 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:22.109664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e44724-c4c5-438b-b750-5aa5e2fe961a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.206638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e44724-c4c5-438b-b750-5aa5e2fe961a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.240310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cb80b-28df-4ba3-8fac-efacea918cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.240951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb80b-28df-4ba3-8fac-efacea918cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.241231 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb80b-28df-4ba3-8fac-efacea918cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.241507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb80b-28df-4ba3-8fac-efacea918cd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.267503 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.310023 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cb80b-28df-4ba3-8fac-efacea918cd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.311405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cb80b-28df-4ba3-8fac-efacea918cd7 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.409764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 570/1144] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:22.416770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f24e3b-1a42-4ae5-89ee-4c95f4fc6eac None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.515900 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f24e3b-1a42-4ae5-89ee-4c95f4fc6eac None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.549757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11938e6c-8334-48c8-9dc3-ed26e744fac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.550644 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11938e6c-8334-48c8-9dc3-ed26e744fac2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.550925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11938e6c-8334-48c8-9dc3-ed26e744fac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.551198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11938e6c-8334-48c8-9dc3-ed26e744fac2 None admin] PATH_INFO: `/v3/projects/0726d66836494b70853bf8a0b322b638` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.552361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11938e6c-8334-48c8-9dc3-ed26e744fac2 None admin] RBAC: Authorizing `identity:get_project(project_id=0726d66836494b70853bf8a0b322b638)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.553774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11938e6c-8334-48c8-9dc3-ed26e744fac2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.555486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 575/1145] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/projects/0726d66836494b70853bf8a0b322b638 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:22.561817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cb80b-28df-4ba3-8fac-efacea918cd7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.618598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.660866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cb80b-28df-4ba3-8fac-efacea918cd7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.693725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4276eaa-c9f8-4c39-803f-241eb5bf6ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.694494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4276eaa-c9f8-4c39-803f-241eb5bf6ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.694775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4276eaa-c9f8-4c39-803f-241eb5bf6ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.695051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4276eaa-c9f8-4c39-803f-241eb5bf6ce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.695878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4276eaa-c9f8-4c39-803f-241eb5bf6ce4 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=0726d66836494b70853bf8a0b322b638, user.id=15dcd39f74e649abae2963688922adc7) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:22.696196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4276eaa-c9f8-4c39-803f-241eb5bf6ce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.697631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4276eaa-c9f8-4c39-803f-241eb5bf6ce4 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.703821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 571/1146] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/role_assignments?user.id=15dcd39f74e649abae2963688922adc7&scope.project.id=0726d66836494b70853bf8a0b322b638&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:24.799633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21816b1e-2964-4b18-a595-29eaf88f6722 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.800151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21816b1e-2964-4b18-a595-29eaf88f6722 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.800151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21816b1e-2964-4b18-a595-29eaf88f6722 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.801535 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 576/1147] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:24.806884 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f2826-a53a-4367-869a-04862dfb4af1 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.807861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f2826-a53a-4367-869a-04862dfb4af1 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.808025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f2826-a53a-4367-869a-04862dfb4af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.824371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-8f3f2826-a53a-4367-869a-04862dfb4af1 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:24.825528 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8f3f2826-a53a-4367-869a-04862dfb4af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:24.890799 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 572/1148] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:24.914465 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21816b1e-2964-4b18-a595-29eaf88f6722 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.980159 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.014383 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21816b1e-2964-4b18-a595-29eaf88f6722 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.047774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e05f08-d26f-4d1f-9b63-63b00aed5ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.048551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05f08-d26f-4d1f-9b63-63b00aed5ada None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.048832 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05f08-d26f-4d1f-9b63-63b00aed5ada None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.049106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05f08-d26f-4d1f-9b63-63b00aed5ada None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.059877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e05f08-d26f-4d1f-9b63-63b00aed5ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-54e05f08-d26f-4d1f-9b63-63b00aed5ada None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:25.067498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:25.068604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:43:25.069648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 577/1149] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:25.075653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f2826-a53a-4367-869a-04862dfb4af1 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.126136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.173104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f2826-a53a-4367-869a-04862dfb4af1 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.206993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c34761-2db2-471e-b67f-7c07c7393e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.207654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c34761-2db2-471e-b67f-7c07c7393e5d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.207936 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c34761-2db2-471e-b67f-7c07c7393e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.208206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c34761-2db2-471e-b67f-7c07c7393e5d None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.208939 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c34761-2db2-471e-b67f-7c07c7393e5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:25.209241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c34761-2db2-471e-b67f-7c07c7393e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.210629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c34761-2db2-471e-b67f-7c07c7393e5d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.219598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 573/1150] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:25.225427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e05f08-d26f-4d1f-9b63-63b00aed5ada None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.324700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e05f08-d26f-4d1f-9b63-63b00aed5ada None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.349767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.358396 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b500e-f75a-4202-a16c-8229a73ddea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.359262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b500e-f75a-4202-a16c-8229a73ddea3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.359539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b500e-f75a-4202-a16c-8229a73ddea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.359809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b500e-f75a-4202-a16c-8229a73ddea3 None admin] PATH_INFO: `/v3/users/15dcd39f74e649abae2963688922adc7` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.360977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b500e-f75a-4202-a16c-8229a73ddea3 None admin] RBAC: Authorizing `identity:get_user(user_id=15dcd39f74e649abae2963688922adc7)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.362422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b500e-f75a-4202-a16c-8229a73ddea3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.364027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 578/1151] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/users/15dcd39f74e649abae2963688922adc7 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:25.370039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c34761-2db2-471e-b67f-7c07c7393e5d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.468254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c34761-2db2-471e-b67f-7c07c7393e5d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.481317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.501057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbd4a8-d0d1-4f2a-81b6-52e1149151a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.501942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd4a8-d0d1-4f2a-81b6-52e1149151a0 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.502226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd4a8-d0d1-4f2a-81b6-52e1149151a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.502501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd4a8-d0d1-4f2a-81b6-52e1149151a0 None admin] PATH_INFO: `/v3/projects/0726d66836494b70853bf8a0b322b638` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.503667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbd4a8-d0d1-4f2a-81b6-52e1149151a0 None admin] RBAC: Authorizing `identity:get_project(project_id=0726d66836494b70853bf8a0b322b638)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.505162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbd4a8-d0d1-4f2a-81b6-52e1149151a0 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.506888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 574/1152] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/projects/0726d66836494b70853bf8a0b322b638 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:25.513834 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b500e-f75a-4202-a16c-8229a73ddea3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.611478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b500e-f75a-4202-a16c-8229a73ddea3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.644791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48285d-4b75-4691-b1c4-c98cf329f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.645675 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48285d-4b75-4691-b1c4-c98cf329f042 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.645986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48285d-4b75-4691-b1c4-c98cf329f042 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.646268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48285d-4b75-4691-b1c4-c98cf329f042 None admin] PATH_INFO: `/v3/projects/0726d66836494b70853bf8a0b322b638/users/15dcd39f74e649abae2963688922adc7/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.648213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48285d-4b75-4691-b1c4-c98cf329f042 None admin] RBAC: Authorizing `identity:create_grant(project_id=0726d66836494b70853bf8a0b322b638, user_id=15dcd39f74e649abae2963688922adc7, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.649643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48285d-4b75-4691-b1c4-c98cf329f042 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.664388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 579/1153] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:25 2022] PUT /identity/v3/projects/0726d66836494b70853bf8a0b322b638/users/15dcd39f74e649abae2963688922adc7/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:27.786173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb553b6-acdb-4d39-9136-1920d18b87c7 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.786694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb553b6-acdb-4d39-9136-1920d18b87c7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.786694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb553b6-acdb-4d39-9136-1920d18b87c7 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.788070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 575/1154] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:27.793684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0ac68-a209-49dc-91ff-f9004cc3c5dc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.794140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0ac68-a209-49dc-91ff-f9004cc3c5dc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.794232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0ac68-a209-49dc-91ff-f9004cc3c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.810459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cfa0ac68-a209-49dc-91ff-f9004cc3c5dc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:27.811630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cfa0ac68-a209-49dc-91ff-f9004cc3c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:27.861455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.879232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 580/1155] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:27.904354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb553b6-acdb-4d39-9136-1920d18b87c7 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.004954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb553b6-acdb-4d39-9136-1920d18b87c7 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.040472 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60080e19-cd76-466f-8698-bfbae7126337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.041264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60080e19-cd76-466f-8698-bfbae7126337 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.041663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60080e19-cd76-466f-8698-bfbae7126337 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.042092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60080e19-cd76-466f-8698-bfbae7126337 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.052609 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60080e19-cd76-466f-8698-bfbae7126337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-60080e19-cd76-466f-8698-bfbae7126337 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:28.060810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:28.062033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:43:28.062893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 576/1156] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:28.069319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0ac68-a209-49dc-91ff-f9004cc3c5dc None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.165383 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0ac68-a209-49dc-91ff-f9004cc3c5dc None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.199170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d58c51-bd2f-4ce7-b805-d77d8487dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.199820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d58c51-bd2f-4ce7-b805-d77d8487dc50 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.200100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d58c51-bd2f-4ce7-b805-d77d8487dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.200371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d58c51-bd2f-4ce7-b805-d77d8487dc50 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.201103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d58c51-bd2f-4ce7-b805-d77d8487dc50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:28.201404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d58c51-bd2f-4ce7-b805-d77d8487dc50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.202789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d58c51-bd2f-4ce7-b805-d77d8487dc50 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.210617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 581/1157] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.216542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60080e19-cd76-466f-8698-bfbae7126337 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.258921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.315508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60080e19-cd76-466f-8698-bfbae7126337 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.349561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af3de-4c23-462d-9c10-75c309993696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.350432 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af3de-4c23-462d-9c10-75c309993696 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.350710 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af3de-4c23-462d-9c10-75c309993696 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.350977 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af3de-4c23-462d-9c10-75c309993696 None admin] PATH_INFO: `/v3/users/15dcd39f74e649abae2963688922adc7` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.352128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2af3de-4c23-462d-9c10-75c309993696 None admin] RBAC: Authorizing `identity:get_user(user_id=15dcd39f74e649abae2963688922adc7)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.353541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2af3de-4c23-462d-9c10-75c309993696 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.355916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 577/1158] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/users/15dcd39f74e649abae2963688922adc7 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.361742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d58c51-bd2f-4ce7-b805-d77d8487dc50 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.411837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.464042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d58c51-bd2f-4ce7-b805-d77d8487dc50 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.497762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32203a52-ef26-4f02-8d60-b83e5ab069a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.498429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32203a52-ef26-4f02-8d60-b83e5ab069a6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.498704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32203a52-ef26-4f02-8d60-b83e5ab069a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.498976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32203a52-ef26-4f02-8d60-b83e5ab069a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.565912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32203a52-ef26-4f02-8d60-b83e5ab069a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.567284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32203a52-ef26-4f02-8d60-b83e5ab069a6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.613903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.667923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 582/1159] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:28.673893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af3de-4c23-462d-9c10-75c309993696 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.773428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af3de-4c23-462d-9c10-75c309993696 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.784349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.807986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3884bd-b128-4aa8-aeb2-c1baaacaab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.808842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3884bd-b128-4aa8-aeb2-c1baaacaab8f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.809115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3884bd-b128-4aa8-aeb2-c1baaacaab8f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.809382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3884bd-b128-4aa8-aeb2-c1baaacaab8f None admin] PATH_INFO: `/v3/projects/0726d66836494b70853bf8a0b322b638` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.810558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3884bd-b128-4aa8-aeb2-c1baaacaab8f None admin] RBAC: Authorizing `identity:get_project(project_id=0726d66836494b70853bf8a0b322b638)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.811973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3884bd-b128-4aa8-aeb2-c1baaacaab8f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.813647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 578/1160] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/projects/0726d66836494b70853bf8a0b322b638 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.819770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32203a52-ef26-4f02-8d60-b83e5ab069a6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.917499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32203a52-ef26-4f02-8d60-b83e5ab069a6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.950488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131cc52-640a-44ef-92d3-02d91c8627b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.951096 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131cc52-640a-44ef-92d3-02d91c8627b8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.951372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131cc52-640a-44ef-92d3-02d91c8627b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.951644 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131cc52-640a-44ef-92d3-02d91c8627b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.952466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131cc52-640a-44ef-92d3-02d91c8627b8 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=0726d66836494b70853bf8a0b322b638, user.id=15dcd39f74e649abae2963688922adc7) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:28.952776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131cc52-640a-44ef-92d3-02d91c8627b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.954218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131cc52-640a-44ef-92d3-02d91c8627b8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.959946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 583/1161] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/role_assignments?user.id=15dcd39f74e649abae2963688922adc7&scope.project.id=0726d66836494b70853bf8a0b322b638&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:31.093785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8f53a-9998-4a42-8680-990803b8eb6c None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.094385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8f53a-9998-4a42-8680-990803b8eb6c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.094385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8f53a-9998-4a42-8680-990803b8eb6c None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.095664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 579/1162] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:31.100653 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686827f-bcfa-42a5-9fb6-77160b9d108e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.101041 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686827f-bcfa-42a5-9fb6-77160b9d108e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.101202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686827f-bcfa-42a5-9fb6-77160b9d108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.117391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2686827f-bcfa-42a5-9fb6-77160b9d108e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:31.118592 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2686827f-bcfa-42a5-9fb6-77160b9d108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:31.126324 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.187458 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 584/1163] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:31.209848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8f53a-9998-4a42-8680-990803b8eb6c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.309925 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8f53a-9998-4a42-8680-990803b8eb6c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.343344 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e4b91-7094-4685-8cbc-301c8a91ecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.344042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e4b91-7094-4685-8cbc-301c8a91ecbb None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.344273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e4b91-7094-4685-8cbc-301c8a91ecbb None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.344549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e4b91-7094-4685-8cbc-301c8a91ecbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.390085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.411376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e4b91-7094-4685-8cbc-301c8a91ecbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.412827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e4b91-7094-4685-8cbc-301c8a91ecbb None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.510502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 580/1164] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:31.516613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686827f-bcfa-42a5-9fb6-77160b9d108e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.613543 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686827f-bcfa-42a5-9fb6-77160b9d108e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.647707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1cb74-a94c-4f76-9bbc-5d6ff2e5db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.648582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1cb74-a94c-4f76-9bbc-5d6ff2e5db0a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.648870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1cb74-a94c-4f76-9bbc-5d6ff2e5db0a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.649146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1cb74-a94c-4f76-9bbc-5d6ff2e5db0a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.656017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1cb74-a94c-4f76-9bbc-5d6ff2e5db0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.657485 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1cb74-a94c-4f76-9bbc-5d6ff2e5db0a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-16a1cb74-a94c-4f76-9bbc-5d6ff2e5db0a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:31.672364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:31.673642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:43:31.674956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 585/1165] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:31.679537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e4b91-7094-4685-8cbc-301c8a91ecbb None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.757055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.780826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e4b91-7094-4685-8cbc-301c8a91ecbb None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.814842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4ad06-dde7-4bea-9753-d3cd08165262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.815506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4ad06-dde7-4bea-9753-d3cd08165262 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.815792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4ad06-dde7-4bea-9753-d3cd08165262 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.816066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4ad06-dde7-4bea-9753-d3cd08165262 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.816778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4ad06-dde7-4bea-9753-d3cd08165262 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:31.817084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4ad06-dde7-4bea-9753-d3cd08165262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.818501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4ad06-dde7-4bea-9753-d3cd08165262 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.825658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 581/1166] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:33.943672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861aaec-c703-46e2-9bdf-283d7e8e6ab9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.944188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861aaec-c703-46e2-9bdf-283d7e8e6ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.944188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861aaec-c703-46e2-9bdf-283d7e8e6ab9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.945527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 586/1167] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:33.950851 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb154c1-02e2-47fe-9602-5ae3d5de0052 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.951285 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb154c1-02e2-47fe-9602-5ae3d5de0052 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.951415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb154c1-02e2-47fe-9602-5ae3d5de0052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.967913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-aeb154c1-02e2-47fe-9602-5ae3d5de0052 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:33.969094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-aeb154c1-02e2-47fe-9602-5ae3d5de0052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:34.037059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 582/1168] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:34.060793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861aaec-c703-46e2-9bdf-283d7e8e6ab9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:34.064381 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:34.163702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861aaec-c703-46e2-9bdf-283d7e8e6ab9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:34.197053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1ec9c-5e70-46f3-a857-de1b8a9ad176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:34.198432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1ec9c-5e70-46f3-a857-de1b8a9ad176 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:34.198890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1ec9c-5e70-46f3-a857-de1b8a9ad176 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:34.199173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1ec9c-5e70-46f3-a857-de1b8a9ad176 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:34.199907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1ec9c-5e70-46f3-a857-de1b8a9ad176 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:34.201277 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1ec9c-5e70-46f3-a857-de1b8a9ad176 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:34.215851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 587/1169] 10.222.0.81 () {60 vars in 1138 bytes} [Thu Jun 16 14:43:34 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:36.395174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aac2ee-9999-4ee3-a726-8c41061a33f5 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.395729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aac2ee-9999-4ee3-a726-8c41061a33f5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.395729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aac2ee-9999-4ee3-a726-8c41061a33f5 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.397121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 583/1170] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:36.402495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144d102-59d3-4348-a180-803853f1403e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.402897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144d102-59d3-4348-a180-803853f1403e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.403058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144d102-59d3-4348-a180-803853f1403e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.419592 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7144d102-59d3-4348-a180-803853f1403e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:36.420775 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7144d102-59d3-4348-a180-803853f1403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:36.476100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:36.487778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 588/1171] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:36.512690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aac2ee-9999-4ee3-a726-8c41061a33f5 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:36.583854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:36.616077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aac2ee-9999-4ee3-a726-8c41061a33f5 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.650563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a3127-841d-4e26-936a-152a9b50601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.651367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a3127-841d-4e26-936a-152a9b50601b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.651687 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a3127-841d-4e26-936a-152a9b50601b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.651967 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a3127-841d-4e26-936a-152a9b50601b None admin] PATH_INFO: `/v3/domains/80c6e7eedd1e460187ebf5cf41878ada` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.662665 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a3127-841d-4e26-936a-152a9b50601b None admin] RBAC: Authorizing `identity:get_domain(domain_id=80c6e7eedd1e460187ebf5cf41878ada)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:36.664119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a3127-841d-4e26-936a-152a9b50601b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:36.665812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 584/1172] 10.222.0.81 () {56 vars in 1183 bytes} [Thu Jun 16 14:43:36 2022] GET /identity/v3/domains/80c6e7eedd1e460187ebf5cf41878ada => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:36.672327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144d102-59d3-4348-a180-803853f1403e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:36.769874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144d102-59d3-4348-a180-803853f1403e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.802258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c49aa-d5c8-4496-acb3-50f49b1266a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.802905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c49aa-d5c8-4496-acb3-50f49b1266a6 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.803182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c49aa-d5c8-4496-acb3-50f49b1266a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.803450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c49aa-d5c8-4496-acb3-50f49b1266a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.804153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c49aa-d5c8-4496-acb3-50f49b1266a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:36.805563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c49aa-d5c8-4496-acb3-50f49b1266a6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:36.831161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 589/1173] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:43:36 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:38.979100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380e7b-073e-4eea-a76b-00fce704a225 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.979593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380e7b-073e-4eea-a76b-00fce704a225 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.979593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380e7b-073e-4eea-a76b-00fce704a225 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.980946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 585/1174] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:38.986226 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d960615-4964-4294-a03f-42ee318bc0e9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.986647 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d960615-4964-4294-a03f-42ee318bc0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.986793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d960615-4964-4294-a03f-42ee318bc0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.003586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5d960615-4964-4294-a03f-42ee318bc0e9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:39.004760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5d960615-4964-4294-a03f-42ee318bc0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:39.045718 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.073315 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 590/1175] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:39.098509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc380e7b-073e-4eea-a76b-00fce704a225 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.201699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc380e7b-073e-4eea-a76b-00fce704a225 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.230703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.236252 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced5a8-e89f-4db6-bfab-ee73437c9e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.237111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced5a8-e89f-4db6-bfab-ee73437c9e81 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.237390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced5a8-e89f-4db6-bfab-ee73437c9e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.237660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced5a8-e89f-4db6-bfab-ee73437c9e81 None admin] PATH_INFO: `/v3/domains/80c6e7eedd1e460187ebf5cf41878ada` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.238855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ced5a8-e89f-4db6-bfab-ee73437c9e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=80c6e7eedd1e460187ebf5cf41878ada)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.240272 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ced5a8-e89f-4db6-bfab-ee73437c9e81 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.241889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 586/1176] 10.222.0.81 () {56 vars in 1183 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/domains/80c6e7eedd1e460187ebf5cf41878ada => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:39.247726 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d960615-4964-4294-a03f-42ee318bc0e9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.343583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d960615-4964-4294-a03f-42ee318bc0e9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.376011 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac27c6-8660-4be5-a08b-e24fe66cc9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.376660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac27c6-8660-4be5-a08b-e24fe66cc9a8 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.376938 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac27c6-8660-4be5-a08b-e24fe66cc9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.377208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac27c6-8660-4be5-a08b-e24fe66cc9a8 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.377919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac27c6-8660-4be5-a08b-e24fe66cc9a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.379334 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac27c6-8660-4be5-a08b-e24fe66cc9a8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.399739 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 591/1177] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:39 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:41.557490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f94f8-40a6-4bde-9561-2b9f31ab5551 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.558070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f94f8-40a6-4bde-9561-2b9f31ab5551 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.558070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f94f8-40a6-4bde-9561-2b9f31ab5551 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.559461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 587/1178] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:41.565170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691407-2202-4152-82c7-ca3345c2256d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.565587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691407-2202-4152-82c7-ca3345c2256d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.565715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691407-2202-4152-82c7-ca3345c2256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.582091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f8691407-2202-4152-82c7-ca3345c2256d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:41.583250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f8691407-2202-4152-82c7-ca3345c2256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:41.606686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:41.648650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 592/1179] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:41.673066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f94f8-40a6-4bde-9561-2b9f31ab5551 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.773504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f94f8-40a6-4bde-9561-2b9f31ab5551 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.807468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadb516-a1b8-49fd-a723-bc7207965776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.808356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadb516-a1b8-49fd-a723-bc7207965776 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.808588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadb516-a1b8-49fd-a723-bc7207965776 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.808863 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadb516-a1b8-49fd-a723-bc7207965776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.819822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadb516-a1b8-49fd-a723-bc7207965776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-4aadb516-a1b8-49fd-a723-bc7207965776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:41.827468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:41.828504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:43:41.829366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 588/1180] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:41.834884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8691407-2202-4152-82c7-ca3345c2256d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.937025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8691407-2202-4152-82c7-ca3345c2256d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.970223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01bf22-c9e3-479f-9f01-336ce88f05ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.970879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01bf22-c9e3-479f-9f01-336ce88f05ce None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.971158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01bf22-c9e3-479f-9f01-336ce88f05ce None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.971430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01bf22-c9e3-479f-9f01-336ce88f05ce None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.972160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01bf22-c9e3-479f-9f01-336ce88f05ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:41.972461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01bf22-c9e3-479f-9f01-336ce88f05ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.973814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01bf22-c9e3-479f-9f01-336ce88f05ce None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.981781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 593/1181] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:41.987586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadb516-a1b8-49fd-a723-bc7207965776 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.046364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.086913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadb516-a1b8-49fd-a723-bc7207965776 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.120197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3a775-d132-4b46-866d-42f7f28b6435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.121070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3a775-d132-4b46-866d-42f7f28b6435 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.121349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3a775-d132-4b46-866d-42f7f28b6435 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.121621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3a775-d132-4b46-866d-42f7f28b6435 None admin] PATH_INFO: `/v3/users/3a64bee535b64caa9fa998b29655a729` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.135135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3a775-d132-4b46-866d-42f7f28b6435 None admin] RBAC: Authorizing `identity:get_user(user_id=3a64bee535b64caa9fa998b29655a729)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.137081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3a775-d132-4b46-866d-42f7f28b6435 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.138796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 589/1182] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/users/3a64bee535b64caa9fa998b29655a729 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:42.144593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01bf22-c9e3-479f-9f01-336ce88f05ce None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.171479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.244778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01bf22-c9e3-479f-9f01-336ce88f05ce None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.278654 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a9a4f-bfac-41ba-9f33-fa1dcc30b108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.279441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a9a4f-bfac-41ba-9f33-fa1dcc30b108 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.279778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a9a4f-bfac-41ba-9f33-fa1dcc30b108 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.280053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a9a4f-bfac-41ba-9f33-fa1dcc30b108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.345185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a9a4f-bfac-41ba-9f33-fa1dcc30b108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.346564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a9a4f-bfac-41ba-9f33-fa1dcc30b108 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.368590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.441806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 594/1183] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:42.448004 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3a775-d132-4b46-866d-42f7f28b6435 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.546674 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3a775-d132-4b46-866d-42f7f28b6435 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.564764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.582279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895782e-fb8b-40ef-9f0c-1f14d44fe559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.583135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895782e-fb8b-40ef-9f0c-1f14d44fe559 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.583413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895782e-fb8b-40ef-9f0c-1f14d44fe559 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.583685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895782e-fb8b-40ef-9f0c-1f14d44fe559 None admin] PATH_INFO: `/v3/projects/86c2a0505e75447295d88aa45e6b2d98` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.584850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895782e-fb8b-40ef-9f0c-1f14d44fe559 None admin] RBAC: Authorizing `identity:get_project(project_id=86c2a0505e75447295d88aa45e6b2d98)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.586386 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895782e-fb8b-40ef-9f0c-1f14d44fe559 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.588183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 590/1184] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/projects/86c2a0505e75447295d88aa45e6b2d98 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:42.594313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a9a4f-bfac-41ba-9f33-fa1dcc30b108 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.690869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a9a4f-bfac-41ba-9f33-fa1dcc30b108 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.712149 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.723581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ca182-74e3-48ac-a1ac-f01d6c14c959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.724229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ca182-74e3-48ac-a1ac-f01d6c14c959 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.724507 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ca182-74e3-48ac-a1ac-f01d6c14c959 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.724778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ca182-74e3-48ac-a1ac-f01d6c14c959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.725588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ca182-74e3-48ac-a1ac-f01d6c14c959 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=86c2a0505e75447295d88aa45e6b2d98, user.id=3a64bee535b64caa9fa998b29655a729) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:42.725914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ca182-74e3-48ac-a1ac-f01d6c14c959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.727322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ca182-74e3-48ac-a1ac-f01d6c14c959 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.733399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 595/1185] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/role_assignments?user.id=3a64bee535b64caa9fa998b29655a729&scope.project.id=86c2a0505e75447295d88aa45e6b2d98&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:44.849590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391fbed-1e8b-44b9-8c7a-f49dc4978baa None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.850143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391fbed-1e8b-44b9-8c7a-f49dc4978baa None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.850234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391fbed-1e8b-44b9-8c7a-f49dc4978baa None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.851608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 591/1186] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:44.857679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dfef5-f70f-4c6e-8d7d-665e1b8064b0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.858109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dfef5-f70f-4c6e-8d7d-665e1b8064b0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.858257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dfef5-f70f-4c6e-8d7d-665e1b8064b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.874864 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-680dfef5-f70f-4c6e-8d7d-665e1b8064b0 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:44.876026 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-680dfef5-f70f-4c6e-8d7d-665e1b8064b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:44.940902 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 596/1187] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:44.964368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391fbed-1e8b-44b9-8c7a-f49dc4978baa None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.064937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391fbed-1e8b-44b9-8c7a-f49dc4978baa None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.099466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6d8c-7f0c-43e5-a4b4-833018b28ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.100246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6d8c-7f0c-43e5-a4b4-833018b28ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.100526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6d8c-7f0c-43e5-a4b4-833018b28ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.100800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6d8c-7f0c-43e5-a4b4-833018b28ed7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.110861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6d8c-7f0c-43e5-a4b4-833018b28ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-16cf6d8c-7f0c-43e5-a4b4-833018b28ed7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:45.118358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:45.119800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:43:45.120962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 592/1188] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:45.125727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dfef5-f70f-4c6e-8d7d-665e1b8064b0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.224361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dfef5-f70f-4c6e-8d7d-665e1b8064b0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.240209 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:45.257998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa64fc-3f56-41b7-8efc-d7b9d62129fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.258667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa64fc-3f56-41b7-8efc-d7b9d62129fa None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.258948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa64fc-3f56-41b7-8efc-d7b9d62129fa None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.259220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa64fc-3f56-41b7-8efc-d7b9d62129fa None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.260920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa64fc-3f56-41b7-8efc-d7b9d62129fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:45.261229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa64fc-3f56-41b7-8efc-d7b9d62129fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:45.262934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa64fc-3f56-41b7-8efc-d7b9d62129fa None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:45.270928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 597/1189] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:45.277229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6d8c-7f0c-43e5-a4b4-833018b28ed7 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.324193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:45.377196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6d8c-7f0c-43e5-a4b4-833018b28ed7 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.411387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce51011-c8ab-4862-aee4-6851ae7693c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.412260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51011-c8ab-4862-aee4-6851ae7693c8 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.412547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51011-c8ab-4862-aee4-6851ae7693c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.412822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51011-c8ab-4862-aee4-6851ae7693c8 None admin] PATH_INFO: `/v3/users/3a64bee535b64caa9fa998b29655a729` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.414043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce51011-c8ab-4862-aee4-6851ae7693c8 None admin] RBAC: Authorizing `identity:get_user(user_id=3a64bee535b64caa9fa998b29655a729)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:45.415482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce51011-c8ab-4862-aee4-6851ae7693c8 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:45.417352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 593/1190] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/users/3a64bee535b64caa9fa998b29655a729 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:45.423115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa64fc-3f56-41b7-8efc-d7b9d62129fa None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.522403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa64fc-3f56-41b7-8efc-d7b9d62129fa None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.554546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2669be-b724-4ec1-9a54-bd8aa6256f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.555406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2669be-b724-4ec1-9a54-bd8aa6256f2a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.555689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2669be-b724-4ec1-9a54-bd8aa6256f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.555964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2669be-b724-4ec1-9a54-bd8aa6256f2a None admin] PATH_INFO: `/v3/projects/86c2a0505e75447295d88aa45e6b2d98` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.558477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2669be-b724-4ec1-9a54-bd8aa6256f2a None admin] RBAC: Authorizing `identity:get_project(project_id=86c2a0505e75447295d88aa45e6b2d98)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:45.559915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2669be-b724-4ec1-9a54-bd8aa6256f2a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:45.561614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 598/1191] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/projects/86c2a0505e75447295d88aa45e6b2d98 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:45.567711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce51011-c8ab-4862-aee4-6851ae7693c8 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.668856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce51011-c8ab-4862-aee4-6851ae7693c8 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.682784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:45.702424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6960b72-80e9-4e34-813b-2551e24704b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.703313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6960b72-80e9-4e34-813b-2551e24704b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.703590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6960b72-80e9-4e34-813b-2551e24704b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.703864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6960b72-80e9-4e34-813b-2551e24704b2 None admin] PATH_INFO: `/v3/projects/86c2a0505e75447295d88aa45e6b2d98/users/3a64bee535b64caa9fa998b29655a729/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.705814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6960b72-80e9-4e34-813b-2551e24704b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=86c2a0505e75447295d88aa45e6b2d98, user_id=3a64bee535b64caa9fa998b29655a729, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:45.707273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6960b72-80e9-4e34-813b-2551e24704b2 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:45.719469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 594/1192] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:45 2022] PUT /identity/v3/projects/86c2a0505e75447295d88aa45e6b2d98/users/3a64bee535b64caa9fa998b29655a729/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:47.809062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5990c-bcae-4cad-bb58-f8035a3e825d None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.809601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5990c-bcae-4cad-bb58-f8035a3e825d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.809601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5990c-bcae-4cad-bb58-f8035a3e825d None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.811026 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 599/1193] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:47.816020 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76742a-a36c-47fc-8bfb-f1c6bb9e39ae None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.816451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76742a-a36c-47fc-8bfb-f1c6bb9e39ae None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.816576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76742a-a36c-47fc-8bfb-f1c6bb9e39ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.833845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ae76742a-a36c-47fc-8bfb-f1c6bb9e39ae None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:47.835066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ae76742a-a36c-47fc-8bfb-f1c6bb9e39ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:47.900456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 595/1194] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:47.923819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5990c-bcae-4cad-bb58-f8035a3e825d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.970116 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.023496 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5990c-bcae-4cad-bb58-f8035a3e825d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.055696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9f752-3d10-4559-9a33-dc0c3c3c2eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.057033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9f752-3d10-4559-9a33-dc0c3c3c2eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.057316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9f752-3d10-4559-9a33-dc0c3c3c2eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.057579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9f752-3d10-4559-9a33-dc0c3c3c2eb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.067678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9f752-3d10-4559-9a33-dc0c3c3c2eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-7ad9f752-3d10-4559-9a33-dc0c3c3c2eb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:48.075265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:48.076358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:43:48.077407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 600/1195] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:48.082424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76742a-a36c-47fc-8bfb-f1c6bb9e39ae None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.177934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76742a-a36c-47fc-8bfb-f1c6bb9e39ae None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.180111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.213385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd353bf-5671-4387-8d0c-3cf53a3e564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.214073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd353bf-5671-4387-8d0c-3cf53a3e564d None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.214353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd353bf-5671-4387-8d0c-3cf53a3e564d None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.214625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd353bf-5671-4387-8d0c-3cf53a3e564d None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.215363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd353bf-5671-4387-8d0c-3cf53a3e564d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:48.215664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd353bf-5671-4387-8d0c-3cf53a3e564d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.217024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd353bf-5671-4387-8d0c-3cf53a3e564d None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.224879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 596/1196] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.231252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9f752-3d10-4559-9a33-dc0c3c3c2eb6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.329064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9f752-3d10-4559-9a33-dc0c3c3c2eb6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.336173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.363408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132260ef-6e3f-4e8c-ba83-5a8000580ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.364280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132260ef-6e3f-4e8c-ba83-5a8000580ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.364561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132260ef-6e3f-4e8c-ba83-5a8000580ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.364827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132260ef-6e3f-4e8c-ba83-5a8000580ca1 None admin] PATH_INFO: `/v3/users/3a64bee535b64caa9fa998b29655a729` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.366041 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132260ef-6e3f-4e8c-ba83-5a8000580ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=3a64bee535b64caa9fa998b29655a729)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.367466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132260ef-6e3f-4e8c-ba83-5a8000580ca1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.369346 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 601/1197] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/users/3a64bee535b64caa9fa998b29655a729 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.375589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd353bf-5671-4387-8d0c-3cf53a3e564d None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.474535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd353bf-5671-4387-8d0c-3cf53a3e564d None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.506953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea4d7a-3388-4ca4-b644-c596ed778228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.507594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea4d7a-3388-4ca4-b644-c596ed778228 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.507873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea4d7a-3388-4ca4-b644-c596ed778228 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.508145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea4d7a-3388-4ca4-b644-c596ed778228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.544882 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.578159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea4d7a-3388-4ca4-b644-c596ed778228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.579618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea4d7a-3388-4ca4-b644-c596ed778228 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.676471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 597/1198] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:48.682892 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132260ef-6e3f-4e8c-ba83-5a8000580ca1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.781578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132260ef-6e3f-4e8c-ba83-5a8000580ca1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.814752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0637d-29de-487f-9fff-d1310951916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.815603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0637d-29de-487f-9fff-d1310951916e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.815883 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0637d-29de-487f-9fff-d1310951916e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.816154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0637d-29de-487f-9fff-d1310951916e None admin] PATH_INFO: `/v3/projects/86c2a0505e75447295d88aa45e6b2d98` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.817316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0637d-29de-487f-9fff-d1310951916e None admin] RBAC: Authorizing `identity:get_project(project_id=86c2a0505e75447295d88aa45e6b2d98)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.818858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0637d-29de-487f-9fff-d1310951916e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.820537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 602/1199] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/projects/86c2a0505e75447295d88aa45e6b2d98 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.826819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea4d7a-3388-4ca4-b644-c596ed778228 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.891473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.926103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea4d7a-3388-4ca4-b644-c596ed778228 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.959760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ca3e7-9471-4662-90fb-9f167728a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.960407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ca3e7-9471-4662-90fb-9f167728a631 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.960687 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ca3e7-9471-4662-90fb-9f167728a631 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.960958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ca3e7-9471-4662-90fb-9f167728a631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.961770 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ca3e7-9471-4662-90fb-9f167728a631 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=86c2a0505e75447295d88aa45e6b2d98, user.id=3a64bee535b64caa9fa998b29655a729) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:48.962112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ca3e7-9471-4662-90fb-9f167728a631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.964115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ca3e7-9471-4662-90fb-9f167728a631 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.969781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 598/1200] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/role_assignments?user.id=3a64bee535b64caa9fa998b29655a729&scope.project.id=86c2a0505e75447295d88aa45e6b2d98&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:58.810709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=79 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.967692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=35 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:46.130455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3a05-b32f-48f4-a01f-4361198f999c None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.131061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3a05-b32f-48f4-a01f-4361198f999c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.131061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3a05-b32f-48f4-a01f-4361198f999c None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.133948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 603/1201] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:46.138879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fef96-b657-4cd4-a4a2-743079008c3b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.139390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fef96-b657-4cd4-a4a2-743079008c3b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.139528 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fef96-b657-4cd4-a4a2-743079008c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.164087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-595fef96-b657-4cd4-a4a2-743079008c3b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:46.166156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-595fef96-b657-4cd4-a4a2-743079008c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:46.265837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 599/1202] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:46.291689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe3a05-b32f-48f4-a01f-4361198f999c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:46.425452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe3a05-b32f-48f4-a01f-4361198f999c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.468831 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934906b-1ba1-4389-a09a-f008f05eac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.470249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934906b-1ba1-4389-a09a-f008f05eac2b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.470249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934906b-1ba1-4389-a09a-f008f05eac2b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.470617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934906b-1ba1-4389-a09a-f008f05eac2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.486650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934906b-1ba1-4389-a09a-f008f05eac2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.488230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934906b-1ba1-4389-a09a-f008f05eac2b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-0934906b-1ba1-4389-a09a-f008f05eac2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:46.513912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:46.514984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:46.519140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:46.519140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:46.519140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:46.519140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:44:46.519140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 604/1203] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:46.521422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fef96-b657-4cd4-a4a2-743079008c3b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:46.665313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fef96-b657-4cd4-a4a2-743079008c3b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.703338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:46.710729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace3e20-5cae-411b-a52c-74054f605bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.711600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3e20-5cae-411b-a52c-74054f605bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.712195 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3e20-5cae-411b-a52c-74054f605bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.712526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3e20-5cae-411b-a52c-74054f605bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.713522 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace3e20-5cae-411b-a52c-74054f605bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:46.713826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace3e20-5cae-411b-a52c-74054f605bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.715428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace3e20-5cae-411b-a52c-74054f605bf2 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.733920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 600/1204] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:46.736022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934906b-1ba1-4389-a09a-f008f05eac2b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:46.805103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:46.861267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934906b-1ba1-4389-a09a-f008f05eac2b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.905419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7164335-8586-4abe-b985-a6440d359f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.906403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7164335-8586-4abe-b985-a6440d359f15 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.906797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7164335-8586-4abe-b985-a6440d359f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.907234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7164335-8586-4abe-b985-a6440d359f15 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.908047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7164335-8586-4abe-b985-a6440d359f15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.909803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7164335-8586-4abe-b985-a6440d359f15 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.935209 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 605/1205] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Jun 16 14:44:46 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:49.264368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4dbed-9c15-4c9b-a40e-a4af0d2d468e None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.264952 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4dbed-9c15-4c9b-a40e-a4af0d2d468e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.264952 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4dbed-9c15-4c9b-a40e-a4af0d2d468e None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.266490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 601/1206] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:49.272137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28927631-b241-4cb1-b267-cf13ea4e271d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.273292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28927631-b241-4cb1-b267-cf13ea4e271d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.273292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28927631-b241-4cb1-b267-cf13ea4e271d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.294421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-28927631-b241-4cb1-b267-cf13ea4e271d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:49.296193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-28927631-b241-4cb1-b267-cf13ea4e271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:49.386443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 606/1207] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:49.414222 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4dbed-9c15-4c9b-a40e-a4af0d2d468e None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.538889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4dbed-9c15-4c9b-a40e-a4af0d2d468e None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.583844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1d8c3-7aa4-4a66-8a4e-9773a53d65b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.584844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1d8c3-7aa4-4a66-8a4e-9773a53d65b6 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.585126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1d8c3-7aa4-4a66-8a4e-9773a53d65b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.585395 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1d8c3-7aa4-4a66-8a4e-9773a53d65b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.598477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1d8c3-7aa4-4a66-8a4e-9773a53d65b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-9af1d8c3-7aa4-4a66-8a4e-9773a53d65b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:49.606724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:49.607888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:44:49.608718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 602/1208] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:49.614498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28927631-b241-4cb1-b267-cf13ea4e271d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.667220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:49.737901 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28927631-b241-4cb1-b267-cf13ea4e271d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.777011 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d59396-9855-42b8-ba0c-8575194f9fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.778330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d59396-9855-42b8-ba0c-8575194f9fac None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.778511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d59396-9855-42b8-ba0c-8575194f9fac None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.778884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d59396-9855-42b8-ba0c-8575194f9fac None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.779796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d59396-9855-42b8-ba0c-8575194f9fac None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:49.780124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d59396-9855-42b8-ba0c-8575194f9fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:49.781683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d59396-9855-42b8-ba0c-8575194f9fac None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:49.791168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 607/1209] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:49.797282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1d8c3-7aa4-4a66-8a4e-9773a53d65b6 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.861113 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:49.923589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1d8c3-7aa4-4a66-8a4e-9773a53d65b6 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.964817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337faa9-45cd-408e-95c2-0f2ceafba498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.965686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337faa9-45cd-408e-95c2-0f2ceafba498 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.966051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337faa9-45cd-408e-95c2-0f2ceafba498 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.966364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337faa9-45cd-408e-95c2-0f2ceafba498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.978469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337faa9-45cd-408e-95c2-0f2ceafba498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:49.980011 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337faa9-45cd-408e-95c2-0f2ceafba498 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-c337faa9-45cd-408e-95c2-0f2ceafba498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:50.002685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:50.003717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:50.004606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:50.004606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:50.004606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:50.004606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:44:50.004606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 603/1210] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:50.012577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d59396-9855-42b8-ba0c-8575194f9fac None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:50.125634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:50.129561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d59396-9855-42b8-ba0c-8575194f9fac None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:50.169525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ead7e-b315-43a3-b0c7-1521d2eac5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:50.170217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ead7e-b315-43a3-b0c7-1521d2eac5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:50.170497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ead7e-b315-43a3-b0c7-1521d2eac5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:50.170769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ead7e-b315-43a3-b0c7-1521d2eac5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:50.171476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ead7e-b315-43a3-b0c7-1521d2eac5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:50.171780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ead7e-b315-43a3-b0c7-1521d2eac5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:50.173132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ead7e-b315-43a3-b0c7-1521d2eac5b3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:50.194460 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 608/1211] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:50.196007 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337faa9-45cd-408e-95c2-0f2ceafba498 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:50.313252 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337faa9-45cd-408e-95c2-0f2ceafba498 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:50.314891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:50.351935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1b8b2-73d9-4ca3-be8b-04dea5808c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:50.352754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b8b2-73d9-4ca3-be8b-04dea5808c76 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:50.353037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b8b2-73d9-4ca3-be8b-04dea5808c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:50.353340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b8b2-73d9-4ca3-be8b-04dea5808c76 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:50.361991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1b8b2-73d9-4ca3-be8b-04dea5808c76 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:50.363494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1b8b2-73d9-4ca3-be8b-04dea5808c76 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-d7c1b8b2-73d9-4ca3-be8b-04dea5808c76 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:50.387692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:50.388790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:50.389743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:50.389743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:50.389743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:50.389743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:50.389743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:50.389743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:50.389743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:50.389743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:50.389743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:44:50.389743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:44:50.389743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 604/1212] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:50.390616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ead7e-b315-43a3-b0c7-1521d2eac5b3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:50.508558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ead7e-b315-43a3-b0c7-1521d2eac5b3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:50.554328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6194fd-ba63-48be-8c75-7982e34a497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:50.555013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6194fd-ba63-48be-8c75-7982e34a497f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:50.555355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6194fd-ba63-48be-8c75-7982e34a497f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:50.555636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6194fd-ba63-48be-8c75-7982e34a497f None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:50.556632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6194fd-ba63-48be-8c75-7982e34a497f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:50.556982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6194fd-ba63-48be-8c75-7982e34a497f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:50.558758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6194fd-ba63-48be-8c75-7982e34a497f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:50.582049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 609/1213] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Jun 16 14:44:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:50.585468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1b8b2-73d9-4ca3-be8b-04dea5808c76 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:50.711017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1b8b2-73d9-4ca3-be8b-04dea5808c76 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:50.753927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45686614-1894-45b4-8e63-e6c4281e7e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:50.754774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45686614-1894-45b4-8e63-e6c4281e7e97 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:50.755064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45686614-1894-45b4-8e63-e6c4281e7e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:50.755407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45686614-1894-45b4-8e63-e6c4281e7e97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:50.793346 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:50.843186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45686614-1894-45b4-8e63-e6c4281e7e97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:50.844667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45686614-1894-45b4-8e63-e6c4281e7e97 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:50.972091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 605/1214] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:50.978933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6194fd-ba63-48be-8c75-7982e34a497f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.003220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.105693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6194fd-ba63-48be-8c75-7982e34a497f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.151516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80dfdb-e7e6-44cc-8649-b0cf6b1b34d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.152320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80dfdb-e7e6-44cc-8649-b0cf6b1b34d3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.152605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80dfdb-e7e6-44cc-8649-b0cf6b1b34d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.152880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80dfdb-e7e6-44cc-8649-b0cf6b1b34d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.165649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80dfdb-e7e6-44cc-8649-b0cf6b1b34d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.167346 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80dfdb-e7e6-44cc-8649-b0cf6b1b34d3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-6f80dfdb-e7e6-44cc-8649-b0cf6b1b34d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:51.187454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:51.188429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:51.189328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:51.189328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:51.189328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:51.189328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:44:51.189328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 610/1215] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:51.195664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45686614-1894-45b4-8e63-e6c4281e7e97 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.270731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.320356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45686614-1894-45b4-8e63-e6c4281e7e97 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.359446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d2a31-c6a9-4359-ab86-5b3bfad8b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.360111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d2a31-c6a9-4359-ab86-5b3bfad8b961 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.360392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d2a31-c6a9-4359-ab86-5b3bfad8b961 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.360669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d2a31-c6a9-4359-ab86-5b3bfad8b961 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.361388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d2a31-c6a9-4359-ab86-5b3bfad8b961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:51.361695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d2a31-c6a9-4359-ab86-5b3bfad8b961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.363245 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d2a31-c6a9-4359-ab86-5b3bfad8b961 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.376003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 606/1216] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:51.382627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80dfdb-e7e6-44cc-8649-b0cf6b1b34d3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.461629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.495068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80dfdb-e7e6-44cc-8649-b0cf6b1b34d3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.532446 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4e3d7-e9b7-4c16-9c57-f99a8bd67515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.533321 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4e3d7-e9b7-4c16-9c57-f99a8bd67515 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.533903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4e3d7-e9b7-4c16-9c57-f99a8bd67515 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.534366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4e3d7-e9b7-4c16-9c57-f99a8bd67515 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.542367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4e3d7-e9b7-4c16-9c57-f99a8bd67515 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.543887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4e3d7-e9b7-4c16-9c57-f99a8bd67515 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-71c4e3d7-e9b7-4c16-9c57-f99a8bd67515 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:51.558029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:51.559194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:51.560307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:51.560307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:51.560307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:51.560307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:51.560307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:51.560307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:51.560307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:51.560307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:44:51.561945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 611/1217] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:51.567706 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d2a31-c6a9-4359-ab86-5b3bfad8b961 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.688668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d2a31-c6a9-4359-ab86-5b3bfad8b961 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.714467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.728902 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a3926-137c-40ef-9a11-307d6db78a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.729563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a3926-137c-40ef-9a11-307d6db78a4c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.729910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a3926-137c-40ef-9a11-307d6db78a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.730148 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a3926-137c-40ef-9a11-307d6db78a4c None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.730936 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a3926-137c-40ef-9a11-307d6db78a4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:51.731239 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a3926-137c-40ef-9a11-307d6db78a4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.732728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a3926-137c-40ef-9a11-307d6db78a4c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.746293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 607/1218] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:51.752711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4e3d7-e9b7-4c16-9c57-f99a8bd67515 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.869143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4e3d7-e9b7-4c16-9c57-f99a8bd67515 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.910587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.918932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d71b71-2d75-45da-a39b-628e156054c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.919771 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d71b71-2d75-45da-a39b-628e156054c3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.920164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d71b71-2d75-45da-a39b-628e156054c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.920616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d71b71-2d75-45da-a39b-628e156054c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.921800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d71b71-2d75-45da-a39b-628e156054c3 None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=57eebea8e2f6424d805d9b84c222b222) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:51.922242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d71b71-2d75-45da-a39b-628e156054c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.924234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d71b71-2d75-45da-a39b-628e156054c3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.930647 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 612/1219] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/role_assignments?user.id=57eebea8e2f6424d805d9b84c222b222&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:54.169866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b40b-2b32-48de-9980-6153623107c6 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.170455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b40b-2b32-48de-9980-6153623107c6 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.170455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b40b-2b32-48de-9980-6153623107c6 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.172002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 608/1220] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:54.177330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2505e47-8b23-4dc1-bcb7-90b7928c4d64 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.177760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2505e47-8b23-4dc1-bcb7-90b7928c4d64 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.178018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2505e47-8b23-4dc1-bcb7-90b7928c4d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.195541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e2505e47-8b23-4dc1-bcb7-90b7928c4d64 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:54.196745 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e2505e47-8b23-4dc1-bcb7-90b7928c4d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:54.272954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 613/1221] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:54.297122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5b40b-2b32-48de-9980-6153623107c6 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.407672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5b40b-2b32-48de-9980-6153623107c6 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.445206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbeb794-83c3-46f6-9654-57caf1cf757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.446008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeb794-83c3-46f6-9654-57caf1cf757c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.446292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeb794-83c3-46f6-9654-57caf1cf757c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.446566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeb794-83c3-46f6-9654-57caf1cf757c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.457975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbeb794-83c3-46f6-9654-57caf1cf757c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-8fbeb794-83c3-46f6-9654-57caf1cf757c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:54.467116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:54.468116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:44:54.469044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 609/1222] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:54.475127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2505e47-8b23-4dc1-bcb7-90b7928c4d64 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.587072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2505e47-8b23-4dc1-bcb7-90b7928c4d64 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.614196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:54.626692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acadf03-4c12-47e2-8e92-d7a7aac9b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.627345 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acadf03-4c12-47e2-8e92-d7a7aac9b019 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.627633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acadf03-4c12-47e2-8e92-d7a7aac9b019 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.627912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acadf03-4c12-47e2-8e92-d7a7aac9b019 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.628696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acadf03-4c12-47e2-8e92-d7a7aac9b019 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:54.629022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acadf03-4c12-47e2-8e92-d7a7aac9b019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:54.630431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acadf03-4c12-47e2-8e92-d7a7aac9b019 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:54.641207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 614/1223] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:54.647312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbeb794-83c3-46f6-9654-57caf1cf757c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.698693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:54.765273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbeb794-83c3-46f6-9654-57caf1cf757c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.801745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655937b5-42c0-4516-820e-a9cddb109e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.802598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655937b5-42c0-4516-820e-a9cddb109e4b None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.802903 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655937b5-42c0-4516-820e-a9cddb109e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.803706 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655937b5-42c0-4516-820e-a9cddb109e4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.815287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655937b5-42c0-4516-820e-a9cddb109e4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:54.816966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655937b5-42c0-4516-820e-a9cddb109e4b None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-655937b5-42c0-4516-820e-a9cddb109e4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:54.837998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:54.839086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:54.846188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:54.846188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:54.846188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:54.846188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:44:54.846188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 610/1224] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:54.846579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acadf03-4c12-47e2-8e92-d7a7aac9b019 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.961807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acadf03-4c12-47e2-8e92-d7a7aac9b019 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.999053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea7bce-443d-4677-8c8d-64df7977d4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.999783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea7bce-443d-4677-8c8d-64df7977d4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.000088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea7bce-443d-4677-8c8d-64df7977d4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.000403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea7bce-443d-4677-8c8d-64df7977d4a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.001304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea7bce-443d-4677-8c8d-64df7977d4a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:55.001639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea7bce-443d-4677-8c8d-64df7977d4a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.003304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea7bce-443d-4677-8c8d-64df7977d4a2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.018948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 615/1225] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:55.025506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655937b5-42c0-4516-820e-a9cddb109e4b None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:55.135016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:55.142992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655937b5-42c0-4516-820e-a9cddb109e4b None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.186758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a292c5-b63c-4310-bef0-4997990c652f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.187593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a292c5-b63c-4310-bef0-4997990c652f None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.187854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a292c5-b63c-4310-bef0-4997990c652f None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.188128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a292c5-b63c-4310-bef0-4997990c652f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.197028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a292c5-b63c-4310-bef0-4997990c652f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.198592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a292c5-b63c-4310-bef0-4997990c652f None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-d9a292c5-b63c-4310-bef0-4997990c652f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:55.213928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:55.215568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:55.217205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:55.217205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:55.217205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:55.217205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:55.217205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:55.217205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:55.217205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:55.217205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:55.217205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:44:55.217205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:44:55.217205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 611/1226] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:55.221139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea7bce-443d-4677-8c8d-64df7977d4a2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:55.275507 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:55.342145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea7bce-443d-4677-8c8d-64df7977d4a2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.380193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86e331-07f4-4914-8c8c-985e150ad377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.380943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86e331-07f4-4914-8c8c-985e150ad377 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.381843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86e331-07f4-4914-8c8c-985e150ad377 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.382239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86e331-07f4-4914-8c8c-985e150ad377 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.383230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86e331-07f4-4914-8c8c-985e150ad377 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:55.383608 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86e331-07f4-4914-8c8c-985e150ad377 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.385505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86e331-07f4-4914-8c8c-985e150ad377 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.405318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 616/1227] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Jun 16 14:44:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:55.411043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a292c5-b63c-4310-bef0-4997990c652f None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:55.524522 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a292c5-b63c-4310-bef0-4997990c652f None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.563016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690202-4cdc-4caa-81a0-28c985534204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.563816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690202-4cdc-4caa-81a0-28c985534204 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.564093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690202-4cdc-4caa-81a0-28c985534204 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.564362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690202-4cdc-4caa-81a0-28c985534204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.576433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3690202-4cdc-4caa-81a0-28c985534204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.578159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3690202-4cdc-4caa-81a0-28c985534204 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-f3690202-4cdc-4caa-81a0-28c985534204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:55.600620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:55.602837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:55.604012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:55.604012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:55.604012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:55.604012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:44:55.604387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 612/1228] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:55.610154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86e331-07f4-4914-8c8c-985e150ad377 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:55.726598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86e331-07f4-4914-8c8c-985e150ad377 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.729817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:55.764221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e8dd1-e5f3-41be-b181-cad648c5920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.764883 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e8dd1-e5f3-41be-b181-cad648c5920f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.765191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e8dd1-e5f3-41be-b181-cad648c5920f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.765433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e8dd1-e5f3-41be-b181-cad648c5920f None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.766174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e8dd1-e5f3-41be-b181-cad648c5920f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:55.766475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e8dd1-e5f3-41be-b181-cad648c5920f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.767835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e8dd1-e5f3-41be-b181-cad648c5920f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.780479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 617/1229] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:55.786493 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690202-4cdc-4caa-81a0-28c985534204 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:55.796821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:55.900082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690202-4cdc-4caa-81a0-28c985534204 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.940101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2363df-4282-48ab-80d5-9232f9e781e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.941052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2363df-4282-48ab-80d5-9232f9e781e3 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.941332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2363df-4282-48ab-80d5-9232f9e781e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.941660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2363df-4282-48ab-80d5-9232f9e781e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.950027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2363df-4282-48ab-80d5-9232f9e781e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.951483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2363df-4282-48ab-80d5-9232f9e781e3 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-cd2363df-4282-48ab-80d5-9232f9e781e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:55.967455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:55.969021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:55.970218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:55.970218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:55.970218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:55.970218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:55.970218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:55.970218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:55.970218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:55.970218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:44:55.970218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 613/1230] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:55.975284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e8dd1-e5f3-41be-b181-cad648c5920f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:56.095000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e8dd1-e5f3-41be-b181-cad648c5920f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:56.136757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b14d61-e973-427e-8ece-2eeec1867a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:56.137715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14d61-e973-427e-8ece-2eeec1867a37 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:56.138056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14d61-e973-427e-8ece-2eeec1867a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:56.138389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14d61-e973-427e-8ece-2eeec1867a37 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:56.139316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b14d61-e973-427e-8ece-2eeec1867a37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:56.139769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b14d61-e973-427e-8ece-2eeec1867a37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:56.141457 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b14d61-e973-427e-8ece-2eeec1867a37 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:56.156711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 618/1231] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:56.162854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2363df-4282-48ab-80d5-9232f9e781e3 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:56.242226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:56.289358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2363df-4282-48ab-80d5-9232f9e781e3 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:56.334419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bcc5f-b8e1-49b8-8fdd-e3852512da24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:56.335375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bcc5f-b8e1-49b8-8fdd-e3852512da24 None admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:56.335672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bcc5f-b8e1-49b8-8fdd-e3852512da24 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:56.335995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bcc5f-b8e1-49b8-8fdd-e3852512da24 None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/57eebea8e2f6424d805d9b84c222b222/roles/6e6c598a68fa410f949be49b804af3f5` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:56.357248 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bcc5f-b8e1-49b8-8fdd-e3852512da24 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=57eebea8e2f6424d805d9b84c222b222, role_id=6e6c598a68fa410f949be49b804af3f5)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:56.357502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bcc5f-b8e1-49b8-8fdd-e3852512da24 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:56.375344 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 614/1232] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:56 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/57eebea8e2f6424d805d9b84c222b222/roles/6e6c598a68fa410f949be49b804af3f5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:58.575289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a34d1-f198-41ac-80e1-19b72290e099 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.575871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a34d1-f198-41ac-80e1-19b72290e099 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.575871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a34d1-f198-41ac-80e1-19b72290e099 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.577379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 619/1233] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:58.583178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4298-a97c-4d2a-adec-208d5fbe8571 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.583766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4298-a97c-4d2a-adec-208d5fbe8571 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.584031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4298-a97c-4d2a-adec-208d5fbe8571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.602815 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-0e1c4298-a97c-4d2a-adec-208d5fbe8571 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:58.604012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0e1c4298-a97c-4d2a-adec-208d5fbe8571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:58.696715 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 615/1234] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:58.721983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a34d1-f198-41ac-80e1-19b72290e099 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:58.753716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:58.841951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a34d1-f198-41ac-80e1-19b72290e099 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:58.878909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54491f69-10dc-481b-82cf-2f9e1c0d8e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:58.879681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54491f69-10dc-481b-82cf-2f9e1c0d8e63 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.880016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54491f69-10dc-481b-82cf-2f9e1c0d8e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.880295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54491f69-10dc-481b-82cf-2f9e1c0d8e63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.892776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54491f69-10dc-481b-82cf-2f9e1c0d8e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-54491f69-10dc-481b-82cf-2f9e1c0d8e63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:58.901860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:58.902847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:44:58.903682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 620/1235] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:58.909111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c4298-a97c-4d2a-adec-208d5fbe8571 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:58.964403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:59.031744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c4298-a97c-4d2a-adec-208d5fbe8571 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.073264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73fe5-4498-43b9-be8b-3f0d22f708ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.074079 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73fe5-4498-43b9-be8b-3f0d22f708ac None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.074470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73fe5-4498-43b9-be8b-3f0d22f708ac None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.074752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73fe5-4498-43b9-be8b-3f0d22f708ac None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.075512 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd73fe5-4498-43b9-be8b-3f0d22f708ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:59.075826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd73fe5-4498-43b9-be8b-3f0d22f708ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.077216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd73fe5-4498-43b9-be8b-3f0d22f708ac None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.088808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 616/1236] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:59.094698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54491f69-10dc-481b-82cf-2f9e1c0d8e63 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.196261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:59.215511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54491f69-10dc-481b-82cf-2f9e1c0d8e63 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.253832 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cdc71-ee16-4c06-8077-616fcd1fb5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.254697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cdc71-ee16-4c06-8077-616fcd1fb5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.255030 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cdc71-ee16-4c06-8077-616fcd1fb5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.255354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cdc71-ee16-4c06-8077-616fcd1fb5a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.268388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cdc71-ee16-4c06-8077-616fcd1fb5a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.270037 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cdc71-ee16-4c06-8077-616fcd1fb5a0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-238cdc71-ee16-4c06-8077-616fcd1fb5a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:59.289519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:59.290709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:59.291825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:59.291825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:59.291825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:59.291825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:44:59.291825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 621/1237] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:59.297528 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73fe5-4498-43b9-be8b-3f0d22f708ac None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.424009 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73fe5-4498-43b9-be8b-3f0d22f708ac None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.435151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:59.462663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad049ee-bdea-4589-86f1-e5d119b1c681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.463332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad049ee-bdea-4589-86f1-e5d119b1c681 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.463612 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad049ee-bdea-4589-86f1-e5d119b1c681 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.463887 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad049ee-bdea-4589-86f1-e5d119b1c681 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.464608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad049ee-bdea-4589-86f1-e5d119b1c681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:59.464905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad049ee-bdea-4589-86f1-e5d119b1c681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.466329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad049ee-bdea-4589-86f1-e5d119b1c681 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.478709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 617/1238] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:59.484774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cdc71-ee16-4c06-8077-616fcd1fb5a0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.598224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cdc71-ee16-4c06-8077-616fcd1fb5a0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.637700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb80558-32bb-4588-9714-f19d8b37e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.638858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb80558-32bb-4588-9714-f19d8b37e666 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.639174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb80558-32bb-4588-9714-f19d8b37e666 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.639485 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb80558-32bb-4588-9714-f19d8b37e666 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.643578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:59.649553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb80558-32bb-4588-9714-f19d8b37e666 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.651425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb80558-32bb-4588-9714-f19d8b37e666 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-0bb80558-32bb-4588-9714-f19d8b37e666 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:59.670304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:59.671547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:59.672682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:59.672682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:59.672682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:59.672682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:59.672682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:59.672682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:59.672682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:59.672682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:59.672682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:44:59.672682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:44:59.672682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 622/1239] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:59.677755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad049ee-bdea-4589-86f1-e5d119b1c681 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.789537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad049ee-bdea-4589-86f1-e5d119b1c681 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.827136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc7957-7ddd-4a55-aeb1-f2a9323fc606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.827816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc7957-7ddd-4a55-aeb1-f2a9323fc606 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.828103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc7957-7ddd-4a55-aeb1-f2a9323fc606 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.828379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc7957-7ddd-4a55-aeb1-f2a9323fc606 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.829219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc7957-7ddd-4a55-aeb1-f2a9323fc606 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:59.829574 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc7957-7ddd-4a55-aeb1-f2a9323fc606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.831570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc7957-7ddd-4a55-aeb1-f2a9323fc606 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.853520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 618/1240] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:59.859265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb80558-32bb-4588-9714-f19d8b37e666 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.971349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb80558-32bb-4588-9714-f19d8b37e666 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:00.010876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ee60-728c-4836-bab2-c4c1c490174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:00.011576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ee60-728c-4836-bab2-c4c1c490174a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:00.011843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ee60-728c-4836-bab2-c4c1c490174a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:00.012157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ee60-728c-4836-bab2-c4c1c490174a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:00.088721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:00.096120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4ee60-728c-4836-bab2-c4c1c490174a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:00.097630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4ee60-728c-4836-bab2-c4c1c490174a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:00.213904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 623/1241] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:00.219647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc7957-7ddd-4a55-aeb1-f2a9323fc606 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:00.250195 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:00.353058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc7957-7ddd-4a55-aeb1-f2a9323fc606 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:00.399621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10d53-46b6-4875-b887-0a921fc3d684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:00.400491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10d53-46b6-4875-b887-0a921fc3d684 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:00.400786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10d53-46b6-4875-b887-0a921fc3d684 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:00.401067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10d53-46b6-4875-b887-0a921fc3d684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:00.413090 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea10d53-46b6-4875-b887-0a921fc3d684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:00.414591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea10d53-46b6-4875-b887-0a921fc3d684 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-5ea10d53-46b6-4875-b887-0a921fc3d684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:00.435086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:00.436320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:00.437453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:00.437453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:00.437453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:00.437453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:00.437453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 619/1242] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:00.442215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ee60-728c-4836-bab2-c4c1c490174a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:00.547899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:00.554707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ee60-728c-4836-bab2-c4c1c490174a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:00.595156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321d21-8968-4f2c-aa05-f3b11f6f843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:00.595811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321d21-8968-4f2c-aa05-f3b11f6f843b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:00.596129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321d21-8968-4f2c-aa05-f3b11f6f843b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:00.596464 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321d21-8968-4f2c-aa05-f3b11f6f843b None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:00.597270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e321d21-8968-4f2c-aa05-f3b11f6f843b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:00.597577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e321d21-8968-4f2c-aa05-f3b11f6f843b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:00.599166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e321d21-8968-4f2c-aa05-f3b11f6f843b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:00.612570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 624/1243] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:00.619125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10d53-46b6-4875-b887-0a921fc3d684 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:00.721664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:00.747808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10d53-46b6-4875-b887-0a921fc3d684 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:00.789234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeb691-fa2a-41b3-9e63-8723f572185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:00.790168 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb691-fa2a-41b3-9e63-8723f572185a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:00.790473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb691-fa2a-41b3-9e63-8723f572185a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:00.790778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb691-fa2a-41b3-9e63-8723f572185a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:00.798056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aeb691-fa2a-41b3-9e63-8723f572185a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:00.799484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aeb691-fa2a-41b3-9e63-8723f572185a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-c3aeb691-fa2a-41b3-9e63-8723f572185a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:45:00.815050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:00.816197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:00.817210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:45:00.817210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:45:00.817210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:45:00.817210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:45:00.817210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:45:00.817210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:45:00.817210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:00.817210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:00.817210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 620/1244] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:00.822370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321d21-8968-4f2c-aa05-f3b11f6f843b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:00.937644 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321d21-8968-4f2c-aa05-f3b11f6f843b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:00.976272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffd8cf-babf-4e55-ae9f-e4e90fcaf268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:00.977041 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffd8cf-babf-4e55-ae9f-e4e90fcaf268 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:00.977382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffd8cf-babf-4e55-ae9f-e4e90fcaf268 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:00.977700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffd8cf-babf-4e55-ae9f-e4e90fcaf268 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:00.978667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffd8cf-babf-4e55-ae9f-e4e90fcaf268 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:00.978980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffd8cf-babf-4e55-ae9f-e4e90fcaf268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:00.980960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffd8cf-babf-4e55-ae9f-e4e90fcaf268 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:00.996156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 625/1245] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:01.002769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeb691-fa2a-41b3-9e63-8723f572185a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:01.126933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeb691-fa2a-41b3-9e63-8723f572185a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:01.167778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb926f-7c26-454f-8540-d8d91b5093fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:01.168678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb926f-7c26-454f-8540-d8d91b5093fd None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:01.168996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb926f-7c26-454f-8540-d8d91b5093fd None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:01.169304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb926f-7c26-454f-8540-d8d91b5093fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:01.170276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb926f-7c26-454f-8540-d8d91b5093fd None admin] RBAC: Adding query filter params (role.id=6e6c598a68fa410f949be49b804af3f5, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=57eebea8e2f6424d805d9b84c222b222) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:01.170626 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb926f-7c26-454f-8540-d8d91b5093fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:01.172164 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb926f-7c26-454f-8540-d8d91b5093fd None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:01.178634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 621/1246] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:01 2022] GET /identity/v3/role_assignments?user.id=57eebea8e2f6424d805d9b84c222b222&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=6e6c598a68fa410f949be49b804af3f5 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:03.667009 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314996-fcea-4390-a701-fe708e0a9a17 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.667635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314996-fcea-4390-a701-fe708e0a9a17 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.667635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314996-fcea-4390-a701-fe708e0a9a17 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.668975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 626/1247] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:45:03.674302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a04ce-2e33-4912-b676-affd338cbcd4 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.674803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a04ce-2e33-4912-b676-affd338cbcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.674905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a04ce-2e33-4912-b676-affd338cbcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.681467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:03.696671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3c9a04ce-2e33-4912-b676-affd338cbcd4 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:03.698163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3c9a04ce-2e33-4912-b676-affd338cbcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:03.777597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 622/1248] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:03.801585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314996-fcea-4390-a701-fe708e0a9a17 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:03.824047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:03.922700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314996-fcea-4390-a701-fe708e0a9a17 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:03.963178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f0b63-3a8a-4f2f-8a45-791ce76d19b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:03.964206 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f0b63-3a8a-4f2f-8a45-791ce76d19b3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.964478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f0b63-3a8a-4f2f-8a45-791ce76d19b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.964757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f0b63-3a8a-4f2f-8a45-791ce76d19b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.979402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f0b63-3a8a-4f2f-8a45-791ce76d19b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-1c6f0b63-3a8a-4f2f-8a45-791ce76d19b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:03.988601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:03.989829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:45:03.991005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 627/1249] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:45:03.996734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a04ce-2e33-4912-b676-affd338cbcd4 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:04.110684 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a04ce-2e33-4912-b676-affd338cbcd4 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.144522 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:04.151858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5356c0b-f958-471e-8243-0517ec35b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.152561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5356c0b-f958-471e-8243-0517ec35b197 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.152844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5356c0b-f958-471e-8243-0517ec35b197 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.153117 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5356c0b-f958-471e-8243-0517ec35b197 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.153871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5356c0b-f958-471e-8243-0517ec35b197 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:04.154205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5356c0b-f958-471e-8243-0517ec35b197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:04.155569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5356c0b-f958-471e-8243-0517ec35b197 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:04.165377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 623/1250] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:04.172012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f0b63-3a8a-4f2f-8a45-791ce76d19b3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:04.270493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:04.297945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f0b63-3a8a-4f2f-8a45-791ce76d19b3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.348835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a9f3a-0134-402c-9cca-64d92aaf5821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.349713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a9f3a-0134-402c-9cca-64d92aaf5821 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.350030 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a9f3a-0134-402c-9cca-64d92aaf5821 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.350357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a9f3a-0134-402c-9cca-64d92aaf5821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.361738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a9f3a-0134-402c-9cca-64d92aaf5821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:04.363259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a9f3a-0134-402c-9cca-64d92aaf5821 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-213a9f3a-0134-402c-9cca-64d92aaf5821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:04.382188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:04.383399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:04.384482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:04.384482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:04.384482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:04.384482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:45:04.384482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 628/1251] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:04.390141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5356c0b-f958-471e-8243-0517ec35b197 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:04.508219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5356c0b-f958-471e-8243-0517ec35b197 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.546975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f82b9-61e9-4e4c-acbe-8f03dc5aa46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.547573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f82b9-61e9-4e4c-acbe-8f03dc5aa46c None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.547855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f82b9-61e9-4e4c-acbe-8f03dc5aa46c None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.548129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f82b9-61e9-4e4c-acbe-8f03dc5aa46c None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.548860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f82b9-61e9-4e4c-acbe-8f03dc5aa46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:04.549171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f82b9-61e9-4e4c-acbe-8f03dc5aa46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:04.550563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f82b9-61e9-4e4c-acbe-8f03dc5aa46c None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:04.564454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 624/1252] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:04.570899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a9f3a-0134-402c-9cca-64d92aaf5821 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:04.703542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a9f3a-0134-402c-9cca-64d92aaf5821 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.732551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:04.742565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9e509-b365-4e1a-9aa2-ed3ac0f53611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.743540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e509-b365-4e1a-9aa2-ed3ac0f53611 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.743863 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e509-b365-4e1a-9aa2-ed3ac0f53611 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.744211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e509-b365-4e1a-9aa2-ed3ac0f53611 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.752785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9e509-b365-4e1a-9aa2-ed3ac0f53611 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:04.754340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9e509-b365-4e1a-9aa2-ed3ac0f53611 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f7e9e509-b365-4e1a-9aa2-ed3ac0f53611 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:45:04.774337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:04.775546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:04.777025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:04.777025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:04.777025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:45:04.777025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:45:04.777025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:45:04.777025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:45:04.777025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:45:04.777025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:45:04.777025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:45:04.777025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:45:04.777025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 629/1253] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:04.781563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f82b9-61e9-4e4c-acbe-8f03dc5aa46c None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:04.844964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:04.896800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f82b9-61e9-4e4c-acbe-8f03dc5aa46c None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.933116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af747c7-7426-472f-9833-7e195cea01e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.933791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af747c7-7426-472f-9833-7e195cea01e8 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.934100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af747c7-7426-472f-9833-7e195cea01e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.934377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af747c7-7426-472f-9833-7e195cea01e8 None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.935216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af747c7-7426-472f-9833-7e195cea01e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:04.935527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af747c7-7426-472f-9833-7e195cea01e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:04.937041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af747c7-7426-472f-9833-7e195cea01e8 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:04.960662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 625/1254] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Jun 16 14:45:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:04.962130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9e509-b365-4e1a-9aa2-ed3ac0f53611 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:05.068189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9e509-b365-4e1a-9aa2-ed3ac0f53611 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:05.104871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb9490-218d-4da3-b065-30b1e6cbcc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:05.105687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9490-218d-4da3-b065-30b1e6cbcc02 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:05.105837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9490-218d-4da3-b065-30b1e6cbcc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:05.106105 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9490-218d-4da3-b065-30b1e6cbcc02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:05.169107 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:05.184543 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb9490-218d-4da3-b065-30b1e6cbcc02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:05.186274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb9490-218d-4da3-b065-30b1e6cbcc02 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:05.300023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 630/1255] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:05.305984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af747c7-7426-472f-9833-7e195cea01e8 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:05.429859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af747c7-7426-472f-9833-7e195cea01e8 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:05.448465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:05.477635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a54aa5-a90d-4ef5-9f08-d4935826a382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:05.478486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a54aa5-a90d-4ef5-9f08-d4935826a382 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:05.478770 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a54aa5-a90d-4ef5-9f08-d4935826a382 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:05.479054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a54aa5-a90d-4ef5-9f08-d4935826a382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:05.492558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a54aa5-a90d-4ef5-9f08-d4935826a382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:05.494076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a54aa5-a90d-4ef5-9f08-d4935826a382 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-40a54aa5-a90d-4ef5-9f08-d4935826a382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:05.515620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:05.516705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:05.517602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:05.517602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:05.517602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:05.517602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:05.517602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 626/1256] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:05.525042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb9490-218d-4da3-b065-30b1e6cbcc02 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:05.635993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:05.653570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb9490-218d-4da3-b065-30b1e6cbcc02 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:05.698460 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcd26d-8573-4e43-a3d0-2569be3deb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:05.699335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcd26d-8573-4e43-a3d0-2569be3deb8d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:05.699675 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcd26d-8573-4e43-a3d0-2569be3deb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:05.700013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcd26d-8573-4e43-a3d0-2569be3deb8d None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:05.700839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcd26d-8573-4e43-a3d0-2569be3deb8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:05.701266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcd26d-8573-4e43-a3d0-2569be3deb8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:05.703017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcd26d-8573-4e43-a3d0-2569be3deb8d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:05.716989 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 631/1257] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:05.722801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a54aa5-a90d-4ef5-9f08-d4935826a382 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:05.836814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a54aa5-a90d-4ef5-9f08-d4935826a382 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:05.877191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3de0a-94c9-481d-b660-adf55c87cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:05.878047 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3de0a-94c9-481d-b660-adf55c87cd0a None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:05.878339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3de0a-94c9-481d-b660-adf55c87cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:05.878614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3de0a-94c9-481d-b660-adf55c87cd0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:05.887443 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3de0a-94c9-481d-b660-adf55c87cd0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:05.888970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3de0a-94c9-481d-b660-adf55c87cd0a None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-0ac3de0a-94c9-481d-b660-adf55c87cd0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:45:05.905015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:05.906296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:05.907436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:45:05.907436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:45:05.907436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:45:05.907436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:45:05.907436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:45:05.907436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:45:05.907436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:05.907436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:05.907436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 627/1258] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:45:05.915377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcd26d-8573-4e43-a3d0-2569be3deb8d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:06.040679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcd26d-8573-4e43-a3d0-2569be3deb8d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:06.082618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68ae21-db5c-4f78-b160-46c5a208c458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:06.083290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68ae21-db5c-4f78-b160-46c5a208c458 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.083576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68ae21-db5c-4f78-b160-46c5a208c458 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.083909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68ae21-db5c-4f78-b160-46c5a208c458 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.084747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68ae21-db5c-4f78-b160-46c5a208c458 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:06.085058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68ae21-db5c-4f78-b160-46c5a208c458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:06.086535 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68ae21-db5c-4f78-b160-46c5a208c458 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:06.100404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 632/1259] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:06.106454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3de0a-94c9-481d-b660-adf55c87cd0a None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:06.142042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:06.224350 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3de0a-94c9-481d-b660-adf55c87cd0a None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:06.262229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f43275-f552-43ba-8eaa-4dd917cd4b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:06.262900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f43275-f552-43ba-8eaa-4dd917cd4b48 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.263182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f43275-f552-43ba-8eaa-4dd917cd4b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.263455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f43275-f552-43ba-8eaa-4dd917cd4b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.264292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f43275-f552-43ba-8eaa-4dd917cd4b48 None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=57eebea8e2f6424d805d9b84c222b222) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:06.264604 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f43275-f552-43ba-8eaa-4dd917cd4b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:06.266080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f43275-f552-43ba-8eaa-4dd917cd4b48 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:06.273688 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 628/1260] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:06 2022] GET /identity/v3/role_assignments?user.id=57eebea8e2f6424d805d9b84c222b222&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:08.379073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5bf0-891c-4b5c-bcea-7c1ec7822c46 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:08.379608 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5bf0-891c-4b5c-bcea-7c1ec7822c46 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:08.379608 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5bf0-891c-4b5c-bcea-7c1ec7822c46 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:08.381823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 633/1261] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:08.387218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350a72-a517-4858-b553-d8dce64160e9 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:08.387630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350a72-a517-4858-b553-d8dce64160e9 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:08.387787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350a72-a517-4858-b553-d8dce64160e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:08.404228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d0350a72-a517-4858-b553-d8dce64160e9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:08.405432 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d0350a72-a517-4858-b553-d8dce64160e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:08.470928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 629/1262] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:08.494122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd5bf0-891c-4b5c-bcea-7c1ec7822c46 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:08.504733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:08.592000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd5bf0-891c-4b5c-bcea-7c1ec7822c46 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:08.625925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279f780-d55c-4f89-bc68-08c283834d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:08.626710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f780-d55c-4f89-bc68-08c283834d37 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:08.626988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f780-d55c-4f89-bc68-08c283834d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:08.627259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f780-d55c-4f89-bc68-08c283834d37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:08.638051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279f780-d55c-4f89-bc68-08c283834d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b279f780-d55c-4f89-bc68-08c283834d37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:08.645472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:08.647028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:45:08.648063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 634/1263] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:08.655779 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350a72-a517-4858-b553-d8dce64160e9 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:08.673838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:08.752588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350a72-a517-4858-b553-d8dce64160e9 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:08.786128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9c056-4994-441f-8397-7cb09c86e268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:08.786827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9c056-4994-441f-8397-7cb09c86e268 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:08.787356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9c056-4994-441f-8397-7cb09c86e268 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:08.787470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9c056-4994-441f-8397-7cb09c86e268 None admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:08.788158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9c056-4994-441f-8397-7cb09c86e268 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:08.788458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9c056-4994-441f-8397-7cb09c86e268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:08.789817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9c056-4994-441f-8397-7cb09c86e268 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:08.797692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 630/1264] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:08.803527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279f780-d55c-4f89-bc68-08c283834d37 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:08.868062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:08.903795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279f780-d55c-4f89-bc68-08c283834d37 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:08.936204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369d3bd-31bf-45f2-936b-b34f9ad02972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:08.936992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369d3bd-31bf-45f2-936b-b34f9ad02972 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:08.937277 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369d3bd-31bf-45f2-936b-b34f9ad02972 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:08.937555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369d3bd-31bf-45f2-936b-b34f9ad02972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:08.948363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369d3bd-31bf-45f2-936b-b34f9ad02972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:08.949796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369d3bd-31bf-45f2-936b-b34f9ad02972 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-8369d3bd-31bf-45f2-936b-b34f9ad02972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:08.967085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:08.968128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:08.969262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:08.969262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:08.969262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:08.969262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:45:08.969262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 635/1265] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:08.974044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9c056-4994-441f-8397-7cb09c86e268 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:09.054565 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:09.074105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9c056-4994-441f-8397-7cb09c86e268 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:09.107177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4bfeb-5a44-4ca0-96dc-c40a80c63e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:09.107832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4bfeb-5a44-4ca0-96dc-c40a80c63e38 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:09.108116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4bfeb-5a44-4ca0-96dc-c40a80c63e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:09.108394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4bfeb-5a44-4ca0-96dc-c40a80c63e38 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:09.109108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4bfeb-5a44-4ca0-96dc-c40a80c63e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:09.109413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4bfeb-5a44-4ca0-96dc-c40a80c63e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:09.110830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4bfeb-5a44-4ca0-96dc-c40a80c63e38 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:09.123681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 631/1266] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:09.129390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369d3bd-31bf-45f2-936b-b34f9ad02972 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:09.235833 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369d3bd-31bf-45f2-936b-b34f9ad02972 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:09.255344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:09.270162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197af10-03a9-4f32-b484-5b9347afd8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:09.270960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197af10-03a9-4f32-b484-5b9347afd8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:09.271508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197af10-03a9-4f32-b484-5b9347afd8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:09.271849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197af10-03a9-4f32-b484-5b9347afd8e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:09.279090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197af10-03a9-4f32-b484-5b9347afd8e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:09.280524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197af10-03a9-4f32-b484-5b9347afd8e6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-0197af10-03a9-4f32-b484-5b9347afd8e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:45:09.296854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:09.297849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:09.299183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:09.299183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:09.299183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:45:09.299183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:45:09.299183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:45:09.299183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:45:09.299183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:45:09.299183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:45:09.299183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:45:09.299183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:45:09.299183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 636/1267] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:09.305094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4bfeb-5a44-4ca0-96dc-c40a80c63e38 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:09.419455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4bfeb-5a44-4ca0-96dc-c40a80c63e38 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:09.452844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc0b60-479a-4e49-8b7f-44de29c516bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:09.453499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc0b60-479a-4e49-8b7f-44de29c516bd None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:09.453782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc0b60-479a-4e49-8b7f-44de29c516bd None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:09.454085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc0b60-479a-4e49-8b7f-44de29c516bd None admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:09.454912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc0b60-479a-4e49-8b7f-44de29c516bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:09.455220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc0b60-479a-4e49-8b7f-44de29c516bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:09.456649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc0b60-479a-4e49-8b7f-44de29c516bd None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:09.465213 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:09.473943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 632/1268] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Jun 16 14:45:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:09.480552 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197af10-03a9-4f32-b484-5b9347afd8e6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:09.578610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197af10-03a9-4f32-b484-5b9347afd8e6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:09.610934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0c570-1575-4042-bcb6-2a821c497708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:09.611710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0c570-1575-4042-bcb6-2a821c497708 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:09.611993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0c570-1575-4042-bcb6-2a821c497708 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:09.612267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0c570-1575-4042-bcb6-2a821c497708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:09.623031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0c570-1575-4042-bcb6-2a821c497708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:09.624465 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0c570-1575-4042-bcb6-2a821c497708 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4ac0c570-1575-4042-bcb6-2a821c497708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:09.641369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:09.642427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:09.643323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:09.643323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:09.643323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:09.643323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:45:09.643323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 637/1269] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:09.648343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc0b60-479a-4e49-8b7f-44de29c516bd None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:09.746484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc0b60-479a-4e49-8b7f-44de29c516bd None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:09.779334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772a06f-d7e6-4818-9337-c2d4684c2904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:09.779991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772a06f-d7e6-4818-9337-c2d4684c2904 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:09.780269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772a06f-d7e6-4818-9337-c2d4684c2904 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:09.780541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772a06f-d7e6-4818-9337-c2d4684c2904 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:09.781241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772a06f-d7e6-4818-9337-c2d4684c2904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:09.781540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772a06f-d7e6-4818-9337-c2d4684c2904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:09.782930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772a06f-d7e6-4818-9337-c2d4684c2904 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:09.794269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 633/1270] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:09.799838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0c570-1575-4042-bcb6-2a821c497708 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:09.830230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:09.899563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0c570-1575-4042-bcb6-2a821c497708 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:09.932919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5a020-6b86-40ca-989a-35b59801fae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:09.933705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5a020-6b86-40ca-989a-35b59801fae4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:09.934014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5a020-6b86-40ca-989a-35b59801fae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:09.934292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5a020-6b86-40ca-989a-35b59801fae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:09.940697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5a020-6b86-40ca-989a-35b59801fae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:09.942153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5a020-6b86-40ca-989a-35b59801fae4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-6cd5a020-6b86-40ca-989a-35b59801fae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:45:09.956469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:09.957520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:09.959164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:45:09.959164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:45:09.959164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:45:09.959164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:45:09.959164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:45:09.959164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:45:09.959164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:09.959164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:45:09.959164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 638/1271] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:09.963957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772a06f-d7e6-4818-9337-c2d4684c2904 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:10.022781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:10.065143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772a06f-d7e6-4818-9337-c2d4684c2904 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:10.098938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc71a5-b834-4347-ae65-3e3cf2b0e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:10.100018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc71a5-b834-4347-ae65-3e3cf2b0e623 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:10.100301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc71a5-b834-4347-ae65-3e3cf2b0e623 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:10.100575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc71a5-b834-4347-ae65-3e3cf2b0e623 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:10.101353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc71a5-b834-4347-ae65-3e3cf2b0e623 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:10.101661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc71a5-b834-4347-ae65-3e3cf2b0e623 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:10.103130 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc71a5-b834-4347-ae65-3e3cf2b0e623 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:10.115049 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 634/1272] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:10.120886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5a020-6b86-40ca-989a-35b59801fae4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:10.211401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:10.220542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5a020-6b86-40ca-989a-35b59801fae4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:10.253994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2c771-1e2b-46ec-9c61-0d618164ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:10.254882 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2c771-1e2b-46ec-9c61-0d618164ad14 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:10.255165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2c771-1e2b-46ec-9c61-0d618164ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:10.255937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2c771-1e2b-46ec-9c61-0d618164ad14 None admin] PATH_INFO: `/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/57eebea8e2f6424d805d9b84c222b222/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:10.258023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2c771-1e2b-46ec-9c61-0d618164ad14 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d9f5e8214467bbeee29fb92bb79e6, user_id=57eebea8e2f6424d805d9b84c222b222, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:10.259454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2c771-1e2b-46ec-9c61-0d618164ad14 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:10.272070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 639/1273] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Jun 16 14:45:10 2022] PUT /identity/v3/projects/2d5d9f5e8214467bbeee29fb92bb79e6/users/57eebea8e2f6424d805d9b84c222b222/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:45:12.450848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d965b-bf8f-427c-8907-9f885872f889 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:12.451407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d965b-bf8f-427c-8907-9f885872f889 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:12.451407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d965b-bf8f-427c-8907-9f885872f889 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:12.452750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 635/1274] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:12.458094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7edfe-3cd9-41e5-b4e1-f6ea7cd553e3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:12.458479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7edfe-3cd9-41e5-b4e1-f6ea7cd553e3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:12.458719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7edfe-3cd9-41e5-b4e1-f6ea7cd553e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:12.476367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d0a7edfe-3cd9-41e5-b4e1-f6ea7cd553e3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:12.477656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d0a7edfe-3cd9-41e5-b4e1-f6ea7cd553e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:12.546238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 640/1275] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:12.571795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d965b-bf8f-427c-8907-9f885872f889 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:12.692152 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d965b-bf8f-427c-8907-9f885872f889 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:12.709928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:12.727104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88e763-512e-4fb1-8212-4cf37ae62379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:12.727887 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88e763-512e-4fb1-8212-4cf37ae62379 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:12.728166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88e763-512e-4fb1-8212-4cf37ae62379 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:12.728436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88e763-512e-4fb1-8212-4cf37ae62379 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:12.738338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88e763-512e-4fb1-8212-4cf37ae62379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-cc88e763-512e-4fb1-8212-4cf37ae62379 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:12.746661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:12.747767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:12.748650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 636/1276] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:12.754035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7edfe-3cd9-41e5-b4e1-f6ea7cd553e3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:12.833708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:12.852087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7edfe-3cd9-41e5-b4e1-f6ea7cd553e3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:12.885682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149697b-4b91-413f-93e1-3128e48b6ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:12.886373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149697b-4b91-413f-93e1-3128e48b6ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:12.886654 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149697b-4b91-413f-93e1-3128e48b6ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:12.886923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149697b-4b91-413f-93e1-3128e48b6ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:12.887651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149697b-4b91-413f-93e1-3128e48b6ee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:12.887952 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149697b-4b91-413f-93e1-3128e48b6ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:12.889293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149697b-4b91-413f-93e1-3128e48b6ee8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:12.897606 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 641/1277] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:12.903711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88e763-512e-4fb1-8212-4cf37ae62379 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.002204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88e763-512e-4fb1-8212-4cf37ae62379 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.034685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f70fd-41cc-4a10-9831-e36548231007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.035461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f70fd-41cc-4a10-9831-e36548231007 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.035738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f70fd-41cc-4a10-9831-e36548231007 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.036007 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f70fd-41cc-4a10-9831-e36548231007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.046495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f70fd-41cc-4a10-9831-e36548231007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.047933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f70fd-41cc-4a10-9831-e36548231007 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-666f70fd-41cc-4a10-9831-e36548231007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:13.064885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:13.065984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:13.067147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:13.067147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:13.067147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:13.067147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:13.067147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 637/1278] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:13.072706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149697b-4b91-413f-93e1-3128e48b6ee8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.171243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149697b-4b91-413f-93e1-3128e48b6ee8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.204041 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b9846-b4d2-4f49-95de-5a747e36df8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.204700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9846-b4d2-4f49-95de-5a747e36df8b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.204990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9846-b4d2-4f49-95de-5a747e36df8b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.205269 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9846-b4d2-4f49-95de-5a747e36df8b None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.206012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b9846-b4d2-4f49-95de-5a747e36df8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:13.206322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b9846-b4d2-4f49-95de-5a747e36df8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.207677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b9846-b4d2-4f49-95de-5a747e36df8b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.219133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 642/1279] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:13.225394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f70fd-41cc-4a10-9831-e36548231007 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.256557 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:13.341278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f70fd-41cc-4a10-9831-e36548231007 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.383663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5451ae8-b5cd-4df7-8056-e2733f9bceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.384489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5451ae8-b5cd-4df7-8056-e2733f9bceb4 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.384766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5451ae8-b5cd-4df7-8056-e2733f9bceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.385288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5451ae8-b5cd-4df7-8056-e2733f9bceb4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.392630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5451ae8-b5cd-4df7-8056-e2733f9bceb4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.394080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5451ae8-b5cd-4df7-8056-e2733f9bceb4 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-a5451ae8-b5cd-4df7-8056-e2733f9bceb4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:45:13.408177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:13.409275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:13.410296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:13.410296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:13.410296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:45:13.410296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:45:13.410296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:45:13.410296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:45:13.410296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:45:13.410296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:45:13.410296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:45:13.410296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:13.410296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 638/1280] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:13.415754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b9846-b4d2-4f49-95de-5a747e36df8b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.419491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:13.513277 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b9846-b4d2-4f49-95de-5a747e36df8b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.550094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792351de-ac9c-45d1-9eda-4b866a6dc3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.550779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792351de-ac9c-45d1-9eda-4b866a6dc3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.551059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792351de-ac9c-45d1-9eda-4b866a6dc3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.551332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792351de-ac9c-45d1-9eda-4b866a6dc3f5 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.552195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792351de-ac9c-45d1-9eda-4b866a6dc3f5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:13.552509 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792351de-ac9c-45d1-9eda-4b866a6dc3f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.554653 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792351de-ac9c-45d1-9eda-4b866a6dc3f5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.572498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 643/1281] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:13.578387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5451ae8-b5cd-4df7-8056-e2733f9bceb4 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.667472 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:13.677678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5451ae8-b5cd-4df7-8056-e2733f9bceb4 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.712522 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0188284-4cc2-45e4-a6c7-3547ad761d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.713216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0188284-4cc2-45e4-a6c7-3547ad761d48 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.713520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0188284-4cc2-45e4-a6c7-3547ad761d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.713820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0188284-4cc2-45e4-a6c7-3547ad761d48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.785845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0188284-4cc2-45e4-a6c7-3547ad761d48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.788097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0188284-4cc2-45e4-a6c7-3547ad761d48 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.876188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:13.887733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 639/1282] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:13.893617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792351de-ac9c-45d1-9eda-4b866a6dc3f5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.954607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:13.991441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792351de-ac9c-45d1-9eda-4b866a6dc3f5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:14.024914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376e905-694e-497a-b3b8-cd92f7f03130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:14.025699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376e905-694e-497a-b3b8-cd92f7f03130 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:14.026007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376e905-694e-497a-b3b8-cd92f7f03130 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:14.026282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376e905-694e-497a-b3b8-cd92f7f03130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:14.035943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376e905-694e-497a-b3b8-cd92f7f03130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:14.037483 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376e905-694e-497a-b3b8-cd92f7f03130 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4376e905-694e-497a-b3b8-cd92f7f03130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:14.054409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:14.055299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:14.056243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:14.056243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:14.056243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:14.056243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:45:14.056243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 644/1283] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:14.061330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0188284-4cc2-45e4-a6c7-3547ad761d48 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:14.159369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0188284-4cc2-45e4-a6c7-3547ad761d48 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:14.192067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622abbb1-5ece-4631-b115-083ffa82f5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:14.192729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622abbb1-5ece-4631-b115-083ffa82f5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:14.193748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622abbb1-5ece-4631-b115-083ffa82f5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:14.194134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622abbb1-5ece-4631-b115-083ffa82f5d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:14.194774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622abbb1-5ece-4631-b115-083ffa82f5d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:14.195080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622abbb1-5ece-4631-b115-083ffa82f5d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:14.196450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622abbb1-5ece-4631-b115-083ffa82f5d4 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:14.207630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 640/1284] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:14.214456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376e905-694e-497a-b3b8-cd92f7f03130 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:14.314251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376e905-694e-497a-b3b8-cd92f7f03130 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:14.328782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:14.348459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff4f8b-ec26-4f1d-aeb2-f93aff58b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:14.349734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff4f8b-ec26-4f1d-aeb2-f93aff58b96a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:14.350046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff4f8b-ec26-4f1d-aeb2-f93aff58b96a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:14.350318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff4f8b-ec26-4f1d-aeb2-f93aff58b96a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:14.356847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff4f8b-ec26-4f1d-aeb2-f93aff58b96a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:14.358316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff4f8b-ec26-4f1d-aeb2-f93aff58b96a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-95ff4f8b-ec26-4f1d-aeb2-f93aff58b96a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:45:14.372746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:14.373776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:14.374749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:45:14.374749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:45:14.374749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:45:14.374749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:45:14.374749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:45:14.374749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:45:14.374749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:14.374749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 16 14:45:14.374749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 645/1285] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Jun 16 14:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:14.379832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622abbb1-5ece-4631-b115-083ffa82f5d4 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:14.431731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:14.481244 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622abbb1-5ece-4631-b115-083ffa82f5d4 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:14.515270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dff71b-0a17-4741-978c-0e6b1acd8dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:14.515932 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dff71b-0a17-4741-978c-0e6b1acd8dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:14.516220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dff71b-0a17-4741-978c-0e6b1acd8dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:14.516497 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dff71b-0a17-4741-978c-0e6b1acd8dd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:14.517274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dff71b-0a17-4741-978c-0e6b1acd8dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:14.517586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dff71b-0a17-4741-978c-0e6b1acd8dd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:14.519064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dff71b-0a17-4741-978c-0e6b1acd8dd5 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:14.530979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 641/1286] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Jun 16 14:45:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:14.537142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff4f8b-ec26-4f1d-aeb2-f93aff58b96a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:14.638367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff4f8b-ec26-4f1d-aeb2-f93aff58b96a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:14.675338 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d6942-a0ce-4710-99c2-393708a5fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:14.676002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d6942-a0ce-4710-99c2-393708a5fb6f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:14.676285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d6942-a0ce-4710-99c2-393708a5fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:14.676563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d6942-a0ce-4710-99c2-393708a5fb6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:14.677971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d6942-a0ce-4710-99c2-393708a5fb6f None admin] RBAC: Adding query filter params (role.id=75d02feb522f48b696d82c55d87d9b23, scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6, user.id=57eebea8e2f6424d805d9b84c222b222) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:14.678356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d6942-a0ce-4710-99c2-393708a5fb6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:14.679795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d6942-a0ce-4710-99c2-393708a5fb6f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:14.685541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 646/1287] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:14 2022] GET /identity/v3/role_assignments?user.id=57eebea8e2f6424d805d9b84c222b222&scope.project.id=2d5d9f5e8214467bbeee29fb92bb79e6&role.id=75d02feb522f48b696d82c55d87d9b23 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:16.839437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c934f6-f7f0-40fb-aa1a-67eb2e3ac19f None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.839994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c934f6-f7f0-40fb-aa1a-67eb2e3ac19f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.839994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c934f6-f7f0-40fb-aa1a-67eb2e3ac19f None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.841337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 642/1288] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:16.846476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51d2a0-9019-4c5a-be6a-42cec050a848 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.846893 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51d2a0-9019-4c5a-be6a-42cec050a848 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.847029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51d2a0-9019-4c5a-be6a-42cec050a848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.864205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-0f51d2a0-9019-4c5a-be6a-42cec050a848 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:16.866051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0f51d2a0-9019-4c5a-be6a-42cec050a848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:16.894564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:16.941099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 647/1289] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:16.964953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c934f6-f7f0-40fb-aa1a-67eb2e3ac19f None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:17.072774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c934f6-f7f0-40fb-aa1a-67eb2e3ac19f None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:17.084294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:17.112354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf015b88-2c18-42a5-b98e-5cf6af05d686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:17.113169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf015b88-2c18-42a5-b98e-5cf6af05d686 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:17.113445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf015b88-2c18-42a5-b98e-5cf6af05d686 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:17.113713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf015b88-2c18-42a5-b98e-5cf6af05d686 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:17.114387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf015b88-2c18-42a5-b98e-5cf6af05d686 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:17.115781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf015b88-2c18-42a5-b98e-5cf6af05d686 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-bf015b88-2c18-42a5-b98e-5cf6af05d686 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:17.127766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:17.128922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:17.129951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 643/1290] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Jun 16 14:45:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:17.135906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51d2a0-9019-4c5a-be6a-42cec050a848 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:17.241685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51d2a0-9019-4c5a-be6a-42cec050a848 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:17.275370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11828-a8df-4d77-98e8-506cafcd6ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:17.276024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11828-a8df-4d77-98e8-506cafcd6ffc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:17.276303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11828-a8df-4d77-98e8-506cafcd6ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:17.276576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11828-a8df-4d77-98e8-506cafcd6ffc None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:17.277273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11828-a8df-4d77-98e8-506cafcd6ffc None admin] RBAC: Adding query filter params (name=placement) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:17.277573 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11828-a8df-4d77-98e8-506cafcd6ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:17.278954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11828-a8df-4d77-98e8-506cafcd6ffc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:17.283609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 648/1291] 10.222.0.81 () {56 vars in 1116 bytes} [Thu Jun 16 14:45:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:17.290654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf015b88-2c18-42a5-b98e-5cf6af05d686 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:17.410517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf015b88-2c18-42a5-b98e-5cf6af05d686 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:17.444683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4db13-e2fe-436c-9dbc-fc21f129bb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:17.445327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4db13-e2fe-436c-9dbc-fc21f129bb58 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:17.445777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4db13-e2fe-436c-9dbc-fc21f129bb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:17.445910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4db13-e2fe-436c-9dbc-fc21f129bb58 None admin] PATH_INFO: `/v3/services` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:17.446600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4db13-e2fe-436c-9dbc-fc21f129bb58 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:17.446916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4db13-e2fe-436c-9dbc-fc21f129bb58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:17.448264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4db13-e2fe-436c-9dbc-fc21f129bb58 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:17.452652 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 644/1292] 10.222.0.81 () {56 vars in 1116 bytes} [Thu Jun 16 14:45:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:19.554853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492092-a928-4de5-84e6-00485dddc563 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:19.555420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492092-a928-4de5-84e6-00485dddc563 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:19.555420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492092-a928-4de5-84e6-00485dddc563 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:19.556759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 649/1293] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:19.561950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f4d3d-57a8-4606-8ae9-453906b3b92f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:19.562335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f4d3d-57a8-4606-8ae9-453906b3b92f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:19.562509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f4d3d-57a8-4606-8ae9-453906b3b92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:19.580578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-cb2f4d3d-57a8-4606-8ae9-453906b3b92f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:19.581768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-cb2f4d3d-57a8-4606-8ae9-453906b3b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:19.610395 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:19.649944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 645/1294] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:19.673208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492092-a928-4de5-84e6-00485dddc563 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:19.712304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:19.782546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492092-a928-4de5-84e6-00485dddc563 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:19.815770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077da0ad-2e04-418c-af9f-6c31e7f6ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:19.816356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077da0ad-2e04-418c-af9f-6c31e7f6ca7a None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:19.816637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077da0ad-2e04-418c-af9f-6c31e7f6ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:19.816908 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077da0ad-2e04-418c-af9f-6c31e7f6ca7a None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:19.818862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077da0ad-2e04-418c-af9f-6c31e7f6ca7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:19.820112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077da0ad-2e04-418c-af9f-6c31e7f6ca7a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:19.832982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 650/1295] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Jun 16 14:45:19 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:45:22.002993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180d04d-1a51-4014-9f4a-bc15bf6ec3c6 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:22.003507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180d04d-1a51-4014-9f4a-bc15bf6ec3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:22.003507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180d04d-1a51-4014-9f4a-bc15bf6ec3c6 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:22.004908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 646/1296] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:45:22.010960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b31c3-d391-4653-b82c-9bf4ad71a6fc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:22.011391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b31c3-d391-4653-b82c-9bf4ad71a6fc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:22.011578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b31c3-d391-4653-b82c-9bf4ad71a6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:22.028468 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-735b31c3-d391-4653-b82c-9bf4ad71a6fc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:22.029763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-735b31c3-d391-4653-b82c-9bf4ad71a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:22.105724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 651/1297] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:22.130328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180d04d-1a51-4014-9f4a-bc15bf6ec3c6 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:22.228114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180d04d-1a51-4014-9f4a-bc15bf6ec3c6 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:22.261958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05231a37-0bb0-4d6e-8928-1dcffb0920ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:22.262703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05231a37-0bb0-4d6e-8928-1dcffb0920ae None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:22.262980 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05231a37-0bb0-4d6e-8928-1dcffb0920ae None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:22.263251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05231a37-0bb0-4d6e-8928-1dcffb0920ae None admin] PATH_INFO: `/v3/services/placement` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:22.263890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05231a37-0bb0-4d6e-8928-1dcffb0920ae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:22.265242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05231a37-0bb0-4d6e-8928-1dcffb0920ae None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-05231a37-0bb0-4d6e-8928-1dcffb0920ae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:22.277082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:22.278111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:22.279000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 647/1298] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Jun 16 14:45:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:22.284312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b31c3-d391-4653-b82c-9bf4ad71a6fc None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:22.303576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:22.382720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b31c3-d391-4653-b82c-9bf4ad71a6fc None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:22.416380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad43eb-637a-4b83-a3cf-567e55173b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:22.417037 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad43eb-637a-4b83-a3cf-567e55173b25 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:22.417316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad43eb-637a-4b83-a3cf-567e55173b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:22.417590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad43eb-637a-4b83-a3cf-567e55173b25 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:22.418318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad43eb-637a-4b83-a3cf-567e55173b25 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:22.418620 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad43eb-637a-4b83-a3cf-567e55173b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:22.419970 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad43eb-637a-4b83-a3cf-567e55173b25 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:22.424991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 652/1299] 10.222.0.81 () {56 vars in 1116 bytes} [Thu Jun 16 14:45:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:22.430989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05231a37-0bb0-4d6e-8928-1dcffb0920ae None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:22.462908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:22.530630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05231a37-0bb0-4d6e-8928-1dcffb0920ae None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:22.563392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d235a46-1467-4fea-8185-aded7f7fdb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:22.564041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d235a46-1467-4fea-8185-aded7f7fdb98 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:22.564321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d235a46-1467-4fea-8185-aded7f7fdb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:22.564593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d235a46-1467-4fea-8185-aded7f7fdb98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:22.565391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d235a46-1467-4fea-8185-aded7f7fdb98 None admin] RBAC: Adding query filter params (interface=public, service_id=e77b203e664242af8cc1c985a8beb3ba, region_id=RegionOne) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:22.565699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d235a46-1467-4fea-8185-aded7f7fdb98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:22.567129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d235a46-1467-4fea-8185-aded7f7fdb98 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:22.572586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 648/1300] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Jun 16 14:45:22 2022] GET /identity/v3/endpoints?service_id=e77b203e664242af8cc1c985a8beb3ba&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:22.578315 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad43eb-637a-4b83-a3cf-567e55173b25 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:22.657786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:22.676111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad43eb-637a-4b83-a3cf-567e55173b25 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:22.713565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffd0af-ee94-4bcf-933b-9649893a4a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:22.714287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffd0af-ee94-4bcf-933b-9649893a4a98 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:22.714571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffd0af-ee94-4bcf-933b-9649893a4a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:22.714878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffd0af-ee94-4bcf-933b-9649893a4a98 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:22.715633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffd0af-ee94-4bcf-933b-9649893a4a98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:22.717082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffd0af-ee94-4bcf-933b-9649893a4a98 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:22.724432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 653/1301] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Jun 16 14:45:22 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:45:24.809936 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef90762-35f0-4f11-86b6-1cd329628faf None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:24.810481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef90762-35f0-4f11-86b6-1cd329628faf None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:24.810481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef90762-35f0-4f11-86b6-1cd329628faf None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:24.811844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 649/1302] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:24.817558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ed428-3976-4921-a99f-3c2b9f0cef18 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:24.818311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ed428-3976-4921-a99f-3c2b9f0cef18 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:24.818311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ed428-3976-4921-a99f-3c2b9f0cef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:24.836533 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9e7ed428-3976-4921-a99f-3c2b9f0cef18 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:24.837780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9e7ed428-3976-4921-a99f-3c2b9f0cef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:24.907042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 654/1303] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:24.932718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef90762-35f0-4f11-86b6-1cd329628faf None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:25.028271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:25.035388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef90762-35f0-4f11-86b6-1cd329628faf None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:25.069479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed324643-e789-42cb-8598-3f1394ffc765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:25.070300 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed324643-e789-42cb-8598-3f1394ffc765 None admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:25.070585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed324643-e789-42cb-8598-3f1394ffc765 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:25.070861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed324643-e789-42cb-8598-3f1394ffc765 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:25.071506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed324643-e789-42cb-8598-3f1394ffc765 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:25.072869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed324643-e789-42cb-8598-3f1394ffc765 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application [None req-ed324643-e789-42cb-8598-3f1394ffc765 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:25.085162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:25.086524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: ERROR keystone.server.flask.application Jun 16 14:45:25.087714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 650/1304] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Jun 16 14:45:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:25.092518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ed428-3976-4921-a99f-3c2b9f0cef18 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:25.168401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:25.192154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ed428-3976-4921-a99f-3c2b9f0cef18 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:25.230247 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f18426-23f4-47c3-b486-7643622068f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:25.230911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f18426-23f4-47c3-b486-7643622068f1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:25.231200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f18426-23f4-47c3-b486-7643622068f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:25.231474 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f18426-23f4-47c3-b486-7643622068f1 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:25.232172 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f18426-23f4-47c3-b486-7643622068f1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:25.232486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f18426-23f4-47c3-b486-7643622068f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:25.233838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f18426-23f4-47c3-b486-7643622068f1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:25.238875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 655/1305] 10.222.0.81 () {56 vars in 1116 bytes} [Thu Jun 16 14:45:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:25.244647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed324643-e789-42cb-8598-3f1394ffc765 None admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:25.343807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed324643-e789-42cb-8598-3f1394ffc765 None admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:25.376218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba4721-4810-439d-9242-3c029c900cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:25.376866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4721-4810-439d-9242-3c029c900cb1 None admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:25.377150 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4721-4810-439d-9242-3c029c900cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:25.377427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4721-4810-439d-9242-3c029c900cb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:25.378186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba4721-4810-439d-9242-3c029c900cb1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:25.379559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba4721-4810-439d-9242-3c029c900cb1 None admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:25.398545 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 651/1306] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Jun 16 14:45:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:45:35.236585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=30 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:35.393742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:29.874291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c171d-ea6f-4558-a1b3-f46337bafd96 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:29.874888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c171d-ea6f-4558-a1b3-f46337bafd96 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:29.874888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c171d-ea6f-4558-a1b3-f46337bafd96 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:29.876222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 656/1307] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:29.881355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e17b7-0eae-4be7-808d-eb0936358843 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:29.881804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e17b7-0eae-4be7-808d-eb0936358843 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:29.881931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e17b7-0eae-4be7-808d-eb0936358843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:29.992348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-150e17b7-0eae-4be7-808d-eb0936358843 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:29.994063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-150e17b7-0eae-4be7-808d-eb0936358843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:30.143543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 652/1308] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:46:30.196485 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0438-bddb-4ea8-bd8b-d835711ddd82 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:30.196778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0438-bddb-4ea8-bd8b-d835711ddd82 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:30.197061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0438-bddb-4ea8-bd8b-d835711ddd82 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:30.198826 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 657/1309] 10.222.0.81 () {54 vars in 964 bytes} [Thu Jun 16 14:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:30.205670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af1877-2550-488c-a054-0b9dc8534541 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:30.206092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af1877-2550-488c-a054-0b9dc8534541 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:30.206551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af1877-2550-488c-a054-0b9dc8534541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:30.305718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-97af1877-2550-488c-a054-0b9dc8534541 None None] MFA Rules not processed for user `8940bddd49534f01a8b1bf1dee644216`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:30.306979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-97af1877-2550-488c-a054-0b9dc8534541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:30.329301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:30.391561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 653/1310] 10.222.0.81 () {58 vars in 1061 bytes} [Thu Jun 16 14:46:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:46:30.400972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d0438-bddb-4ea8-bd8b-d835711ddd82 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:30.402748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-986d0438-bddb-4ea8-bd8b-d835711ddd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:30.522403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d0438-bddb-4ea8-bd8b-d835711ddd82 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:30.605875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be2973-7f7d-4d7c-bfcf-d01e945899a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:30.606557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2973-7f7d-4d7c-bfcf-d01e945899a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:30.606842 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2973-7f7d-4d7c-bfcf-d01e945899a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:30.607118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2973-7f7d-4d7c-bfcf-d01e945899a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:30.608786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-62be2973-7f7d-4d7c-bfcf-d01e945899a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:30.680842 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:30.744985 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be2973-7f7d-4d7c-bfcf-d01e945899a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:30.746501 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be2973-7f7d-4d7c-bfcf-d01e945899a1 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:30.769595 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 658/1311] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:46:33.347854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437f44a-6697-41c5-9dbf-ecf9cb9b7a13 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:33.348380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437f44a-6697-41c5-9dbf-ecf9cb9b7a13 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:33.348476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437f44a-6697-41c5-9dbf-ecf9cb9b7a13 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:33.349797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 654/1312] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:33.355077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865bd69-e830-4e6a-9160-7224da6e7c40 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:33.355479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865bd69-e830-4e6a-9160-7224da6e7c40 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:33.355633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865bd69-e830-4e6a-9160-7224da6e7c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:33.463224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e865bd69-e830-4e6a-9160-7224da6e7c40 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:33.464347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e865bd69-e830-4e6a-9160-7224da6e7c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:33.566453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 659/1313] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:46:33.604470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437f44a-6697-41c5-9dbf-ecf9cb9b7a13 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:33.606024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b437f44a-6697-41c5-9dbf-ecf9cb9b7a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:33.716895 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437f44a-6697-41c5-9dbf-ecf9cb9b7a13 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:33.790757 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:33.793416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22045ecc-75f0-44d9-9470-929b47dede28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:33.794339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22045ecc-75f0-44d9-9470-929b47dede28 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:33.794831 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22045ecc-75f0-44d9-9470-929b47dede28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:33.795126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22045ecc-75f0-44d9-9470-929b47dede28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:33.796986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-22045ecc-75f0-44d9-9470-929b47dede28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:33.907420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22045ecc-75f0-44d9-9470-929b47dede28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:33.908888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22045ecc-75f0-44d9-9470-929b47dede28 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:33.928550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 655/1314] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:46:36.432737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0618d-178d-44a3-9cc9-a4e626560a79 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:36.433270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0618d-178d-44a3-9cc9-a4e626560a79 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:36.433270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0618d-178d-44a3-9cc9-a4e626560a79 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:36.434710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 660/1315] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:36.440800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513eca6-3921-490a-a573-0364dc6dbee1 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:36.441228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513eca6-3921-490a-a573-0364dc6dbee1 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:36.441331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513eca6-3921-490a-a573-0364dc6dbee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:36.504544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a513eca6-3921-490a-a573-0364dc6dbee1 None None] MFA Rules not processed for user `1c0d1ccb3a22469bbe646d3ebef6e225`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:36.505746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a513eca6-3921-490a-a573-0364dc6dbee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:36.559065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:36.606469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 656/1316] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:46:36.660433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc4118-bcf3-4eb0-b4e5-bfccc39530da None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:36.660807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc4118-bcf3-4eb0-b4e5-bfccc39530da None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:36.661156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc4118-bcf3-4eb0-b4e5-bfccc39530da None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:36.662504 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 661/1317] 10.222.0.81 () {54 vars in 964 bytes} [Thu Jun 16 14:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:36.668299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606522c3-483e-4e08-a96a-19a79a57fdd9 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:36.668585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606522c3-483e-4e08-a96a-19a79a57fdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:36.668860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606522c3-483e-4e08-a96a-19a79a57fdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:36.744266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-606522c3-483e-4e08-a96a-19a79a57fdd9 None None] MFA Rules not processed for user `8940bddd49534f01a8b1bf1dee644216`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:36.745407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-606522c3-483e-4e08-a96a-19a79a57fdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:36.822326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 657/1318] 10.222.0.81 () {58 vars in 1061 bytes} [Thu Jun 16 14:46:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:46:36.831793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc4118-bcf3-4eb0-b4e5-bfccc39530da None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:36.833434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bedc4118-bcf3-4eb0-b4e5-bfccc39530da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:36.843308 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:36.937251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc4118-bcf3-4eb0-b4e5-bfccc39530da None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:37.010989 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ec9b9-f2a8-43d5-80de-acb2cf98cc35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:37.011554 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec9b9-f2a8-43d5-80de-acb2cf98cc35 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:37.011831 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec9b9-f2a8-43d5-80de-acb2cf98cc35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:37.012103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec9b9-f2a8-43d5-80de-acb2cf98cc35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:37.013720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-953ec9b9-f2a8-43d5-80de-acb2cf98cc35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:37.073662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:37.120714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ec9b9-f2a8-43d5-80de-acb2cf98cc35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:37.122171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ec9b9-f2a8-43d5-80de-acb2cf98cc35 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:37.139780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 662/1319] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:46:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:46:40.206193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9377b9-7ba5-40d3-b6ac-ee01ad29e879 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:40.206761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9377b9-7ba5-40d3-b6ac-ee01ad29e879 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:40.206761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9377b9-7ba5-40d3-b6ac-ee01ad29e879 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:40.208169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 658/1320] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:40.213258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ca408-c12c-426b-8862-856af13bbbc9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:40.213677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ca408-c12c-426b-8862-856af13bbbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:40.213790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ca408-c12c-426b-8862-856af13bbbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:40.277081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-436ca408-c12c-426b-8862-856af13bbbc9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:40.278310 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-436ca408-c12c-426b-8862-856af13bbbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:40.379772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 663/1321] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:46:40.418246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9377b9-7ba5-40d3-b6ac-ee01ad29e879 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:40.419783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-bf9377b9-7ba5-40d3-b6ac-ee01ad29e879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:40.470345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:40.523520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9377b9-7ba5-40d3-b6ac-ee01ad29e879 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:40.597044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45562da-2528-4f04-912c-2119c1381673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:40.597693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45562da-2528-4f04-912c-2119c1381673 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:40.598006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45562da-2528-4f04-912c-2119c1381673 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:40.598287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45562da-2528-4f04-912c-2119c1381673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:40.599947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a45562da-2528-4f04-912c-2119c1381673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:40.697343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:40.711355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45562da-2528-4f04-912c-2119c1381673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:40.712800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45562da-2528-4f04-912c-2119c1381673 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:40.731805 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 659/1322] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:46:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:46:43.551965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d933e3d-6442-43f6-9977-0a5945fa65e2 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:43.552525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d933e3d-6442-43f6-9977-0a5945fa65e2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:43.552525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d933e3d-6442-43f6-9977-0a5945fa65e2 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:43.553947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 664/1323] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:43.559205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfee5e4-67d1-4710-b365-5bcd843943b7 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:43.559616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfee5e4-67d1-4710-b365-5bcd843943b7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:43.559728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfee5e4-67d1-4710-b365-5bcd843943b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:43.639694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-9bfee5e4-67d1-4710-b365-5bcd843943b7 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:43.640918 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9bfee5e4-67d1-4710-b365-5bcd843943b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:43.751975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 660/1324] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:46:43.789700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d933e3d-6442-43f6-9977-0a5945fa65e2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:43.791264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7d933e3d-6442-43f6-9977-0a5945fa65e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:43.810246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:43.899565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d933e3d-6442-43f6-9977-0a5945fa65e2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:43.975134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430519fe-1216-484a-ab91-bbcf76a68815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:43.975780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430519fe-1216-484a-ab91-bbcf76a68815 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:43.976058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430519fe-1216-484a-ab91-bbcf76a68815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:43.976330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430519fe-1216-484a-ab91-bbcf76a68815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:43.978012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-430519fe-1216-484a-ab91-bbcf76a68815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:44.053230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:44.091811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430519fe-1216-484a-ab91-bbcf76a68815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:44.093238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430519fe-1216-484a-ab91-bbcf76a68815 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:44.112516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 665/1325] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:46:46.323993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777fb76-87d3-4468-9f76-d8121aaf406c None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:46.324546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777fb76-87d3-4468-9f76-d8121aaf406c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:46.324546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777fb76-87d3-4468-9f76-d8121aaf406c None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:46.325854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 661/1326] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:46.332436 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aeb00-ff5f-4d64-a85f-1a28e2765b74 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:46.332879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aeb00-ff5f-4d64-a85f-1a28e2765b74 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:46.333006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aeb00-ff5f-4d64-a85f-1a28e2765b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:46.398304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-459aeb00-ff5f-4d64-a85f-1a28e2765b74 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:46.399523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-459aeb00-ff5f-4d64-a85f-1a28e2765b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:46.498666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 666/1327] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:46:46.535306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777fb76-87d3-4468-9f76-d8121aaf406c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:46.536839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1777fb76-87d3-4468-9f76-d8121aaf406c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:46.601836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:46.649447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777fb76-87d3-4468-9f76-d8121aaf406c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:46.726240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7c229-2b69-416a-87c3-ae41ccce54dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:46.726898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7c229-2b69-416a-87c3-ae41ccce54dd service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:46.727184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7c229-2b69-416a-87c3-ae41ccce54dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:46.727463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7c229-2b69-416a-87c3-ae41ccce54dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:46.729146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-77a7c229-2b69-416a-87c3-ae41ccce54dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:46.846901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:46.849445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7c229-2b69-416a-87c3-ae41ccce54dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:46.851393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7c229-2b69-416a-87c3-ae41ccce54dd service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:46.870756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 662/1328] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:46:49.193122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402dd79-c10e-4f53-8f58-f700d743edf6 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:49.193676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402dd79-c10e-4f53-8f58-f700d743edf6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:49.193791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402dd79-c10e-4f53-8f58-f700d743edf6 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:49.195253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 667/1329] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:49.200730 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0a307-ca3e-4784-9ce9-fe8f930bd627 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:49.201174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0a307-ca3e-4784-9ce9-fe8f930bd627 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:49.201269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0a307-ca3e-4784-9ce9-fe8f930bd627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:49.272862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d9e0a307-ca3e-4784-9ce9-fe8f930bd627 None None] MFA Rules not processed for user `1c0d1ccb3a22469bbe646d3ebef6e225`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:49.274091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d9e0a307-ca3e-4784-9ce9-fe8f930bd627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:49.371999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 663/1330] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:46:49.411485 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402dd79-c10e-4f53-8f58-f700d743edf6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:49.413022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6402dd79-c10e-4f53-8f58-f700d743edf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:49.450038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:49.533822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402dd79-c10e-4f53-8f58-f700d743edf6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:49.617061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa6559-6061-4e81-80e4-ff6bd4d293c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:49.617757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6559-6061-4e81-80e4-ff6bd4d293c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:49.618025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6559-6061-4e81-80e4-ff6bd4d293c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:49.618300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6559-6061-4e81-80e4-ff6bd4d293c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:49.619952 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e9fa6559-6061-4e81-80e4-ff6bd4d293c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:49.706927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:49.741976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa6559-6061-4e81-80e4-ff6bd4d293c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:49.743344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa6559-6061-4e81-80e4-ff6bd4d293c4 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:49.764674 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 668/1331] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:46:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:46:52.180336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e795872-fbd0-4ef5-84ca-6296babe9355 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:52.180920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e795872-fbd0-4ef5-84ca-6296babe9355 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:52.180920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e795872-fbd0-4ef5-84ca-6296babe9355 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:52.182286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 664/1332] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:52.187327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375ca1d-42b6-4a24-8f33-42acfb97b48a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:52.187724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375ca1d-42b6-4a24-8f33-42acfb97b48a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:52.188360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375ca1d-42b6-4a24-8f33-42acfb97b48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:52.254206 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3375ca1d-42b6-4a24-8f33-42acfb97b48a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:52.255436 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3375ca1d-42b6-4a24-8f33-42acfb97b48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:52.352873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 669/1333] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:46:52.388301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e795872-fbd0-4ef5-84ca-6296babe9355 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:52.389827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7e795872-fbd0-4ef5-84ca-6296babe9355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:52.459217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:52.493599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e795872-fbd0-4ef5-84ca-6296babe9355 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:52.569077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a1954-d8bc-4598-9dd4-ad15fc058f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:52.569723 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a1954-d8bc-4598-9dd4-ad15fc058f78 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:52.570043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a1954-d8bc-4598-9dd4-ad15fc058f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:52.570316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a1954-d8bc-4598-9dd4-ad15fc058f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:52.571965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2d5a1954-d8bc-4598-9dd4-ad15fc058f78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:52.681509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a1954-d8bc-4598-9dd4-ad15fc058f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:52.682989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a1954-d8bc-4598-9dd4-ad15fc058f78 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:52.693332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:52.701634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 665/1334] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:46:54.861234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670b884-b4bc-4818-ba99-c759acdc5074 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:54.861795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670b884-b4bc-4818-ba99-c759acdc5074 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:54.861916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670b884-b4bc-4818-ba99-c759acdc5074 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:54.863432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 670/1335] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:54.869137 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec64a-86b1-44c2-abe2-2c16c966dd61 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:54.869624 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec64a-86b1-44c2-abe2-2c16c966dd61 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:54.869763 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec64a-86b1-44c2-abe2-2c16c966dd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:54.939153 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-9b7ec64a-86b1-44c2-abe2-2c16c966dd61 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:54.940323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9b7ec64a-86b1-44c2-abe2-2c16c966dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:55.038334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 666/1336] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:46:55.078561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670b884-b4bc-4818-ba99-c759acdc5074 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:55.080883 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f670b884-b4bc-4818-ba99-c759acdc5074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:55.120202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:55.184971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670b884-b4bc-4818-ba99-c759acdc5074 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:55.257182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd4b74-c484-4677-b5c9-e11e21489fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:55.257750 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4b74-c484-4677-b5c9-e11e21489fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:55.258312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4b74-c484-4677-b5c9-e11e21489fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:55.258583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4b74-c484-4677-b5c9-e11e21489fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:55.260208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8dcd4b74-c484-4677-b5c9-e11e21489fe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:55.349550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:55.376376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd4b74-c484-4677-b5c9-e11e21489fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:55.377812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd4b74-c484-4677-b5c9-e11e21489fe3 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:55.396698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 671/1337] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:46:57.912496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42bcb-0e8e-4d87-b804-527b6d055621 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:57.913061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42bcb-0e8e-4d87-b804-527b6d055621 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:57.913061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42bcb-0e8e-4d87-b804-527b6d055621 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:57.914503 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 667/1338] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:57.919807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe53c29-9c00-4d71-b9a5-805d34a30b62 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:57.920217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe53c29-9c00-4d71-b9a5-805d34a30b62 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:57.920359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe53c29-9c00-4d71-b9a5-805d34a30b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:57.985442 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1fe53c29-9c00-4d71-b9a5-805d34a30b62 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:57.986591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1fe53c29-9c00-4d71-b9a5-805d34a30b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:58.082328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 672/1339] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:46:58.119850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f42bcb-0e8e-4d87-b804-527b6d055621 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:58.121375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c0f42bcb-0e8e-4d87-b804-527b6d055621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:58.198790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:58.227143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f42bcb-0e8e-4d87-b804-527b6d055621 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:58.300661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e284c28-6f3f-4152-b1a3-f1d707332873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:58.301311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e284c28-6f3f-4152-b1a3-f1d707332873 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:58.301595 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e284c28-6f3f-4152-b1a3-f1d707332873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:58.301876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e284c28-6f3f-4152-b1a3-f1d707332873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:58.303564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8e284c28-6f3f-4152-b1a3-f1d707332873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:58.411967 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e284c28-6f3f-4152-b1a3-f1d707332873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:58.413433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e284c28-6f3f-4152-b1a3-f1d707332873 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:58.432223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 668/1340] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:46:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:02.649492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b491c-9080-4135-9946-cf7aeaed5cb9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:02.650125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b491c-9080-4135-9946-cf7aeaed5cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:02.650125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b491c-9080-4135-9946-cf7aeaed5cb9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:02.651374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 673/1341] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:02.659680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6d3b-1ad5-4684-8629-19cdba19042c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:02.659680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6d3b-1ad5-4684-8629-19cdba19042c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:02.659680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6d3b-1ad5-4684-8629-19cdba19042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:02.665027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:02.746220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-f30c6d3b-1ad5-4684-8629-19cdba19042c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:02.748274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f30c6d3b-1ad5-4684-8629-19cdba19042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:02.861157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 669/1342] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:02.899474 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b491c-9080-4135-9946-cf7aeaed5cb9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:02.901705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-202b491c-9080-4135-9946-cf7aeaed5cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:02.952523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:03.000193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b491c-9080-4135-9946-cf7aeaed5cb9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:03.003759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cebcb0-d02b-4a99-8766-5720e03c0cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:03.004409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cebcb0-d02b-4a99-8766-5720e03c0cae service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:03.004684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cebcb0-d02b-4a99-8766-5720e03c0cae service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:03.004956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cebcb0-d02b-4a99-8766-5720e03c0cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:03.014465 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cebcb0-d02b-4a99-8766-5720e03c0cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:03.016584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cebcb0-d02b-4a99-8766-5720e03c0cae service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:03.026023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 674/1343] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:05.929519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0fa21-75de-4e08-8eef-ff55b50aac2c None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:05.929973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0fa21-75de-4e08-8eef-ff55b50aac2c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:05.930233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0fa21-75de-4e08-8eef-ff55b50aac2c None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:05.931473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 670/1344] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:05.939515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f392-fc15-482d-affc-dc00b4c80950 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:05.940048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f392-fc15-482d-affc-dc00b4c80950 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:05.940208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f392-fc15-482d-affc-dc00b4c80950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:05.970264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c0c4f392-fc15-482d-affc-dc00b4c80950 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:05.971609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c0c4f392-fc15-482d-affc-dc00b4c80950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:06.056757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 675/1345] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:06.094713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0fa21-75de-4e08-8eef-ff55b50aac2c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:06.106175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0fa21-75de-4e08-8eef-ff55b50aac2c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:06.110484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea6b62-3d0e-4d2d-ae55-92d3f1a7813a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:06.111118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea6b62-3d0e-4d2d-ae55-92d3f1a7813a service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:06.111411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea6b62-3d0e-4d2d-ae55-92d3f1a7813a service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:06.111684 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea6b62-3d0e-4d2d-ae55-92d3f1a7813a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:06.122011 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea6b62-3d0e-4d2d-ae55-92d3f1a7813a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:06.123470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea6b62-3d0e-4d2d-ae55-92d3f1a7813a service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:06.135096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 671/1346] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:10.264713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048e8a9-b5fb-4154-9ef5-084028fbdc40 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:10.265283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048e8a9-b5fb-4154-9ef5-084028fbdc40 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:10.265380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048e8a9-b5fb-4154-9ef5-084028fbdc40 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:10.267001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 676/1347] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:10.272378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27620-fdfb-4c51-b200-e87018bc126c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:10.272782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27620-fdfb-4c51-b200-e87018bc126c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:10.272937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27620-fdfb-4c51-b200-e87018bc126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:10.292283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c6a27620-fdfb-4c51-b200-e87018bc126c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:10.293495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c6a27620-fdfb-4c51-b200-e87018bc126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:10.303305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 672/1348] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:10.341143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048e8a9-b5fb-4154-9ef5-084028fbdc40 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:10.353136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048e8a9-b5fb-4154-9ef5-084028fbdc40 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:10.356698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685a457-a007-4787-b0ef-b135eee5d1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:10.357350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685a457-a007-4787-b0ef-b135eee5d1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:10.357634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685a457-a007-4787-b0ef-b135eee5d1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:10.357931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685a457-a007-4787-b0ef-b135eee5d1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:10.368001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685a457-a007-4787-b0ef-b135eee5d1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:10.369436 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685a457-a007-4787-b0ef-b135eee5d1d5 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:10.379384 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 677/1349] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:15.426188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b398-3c8f-4671-a9a8-05049903022b None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:15.426668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b398-3c8f-4671-a9a8-05049903022b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:15.426764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b398-3c8f-4671-a9a8-05049903022b None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:15.428746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 673/1350] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 14:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:15.434136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a1759-95ca-4ddb-91c7-e2fec9268bcc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:15.434918 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a1759-95ca-4ddb-91c7-e2fec9268bcc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:15.435347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a1759-95ca-4ddb-91c7-e2fec9268bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:15.528515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f28a1759-95ca-4ddb-91c7-e2fec9268bcc None None] MFA Rules not processed for user `57eebea8e2f6424d805d9b84c222b222`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:15.529709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f28a1759-95ca-4ddb-91c7-e2fec9268bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:15.566197 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:15.631395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 678/1351] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:20.067632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382cfdf-9eed-4440-bdc5-3239e49fb1f4 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:20.068590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382cfdf-9eed-4440-bdc5-3239e49fb1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:20.068869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382cfdf-9eed-4440-bdc5-3239e49fb1f4 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:20.070441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 674/1352] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 14:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:20.075858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d6ca-0a4d-471f-b7a7-f938689418c7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:20.076273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d6ca-0a4d-471f-b7a7-f938689418c7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:20.076420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d6ca-0a4d-471f-b7a7-f938689418c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:20.096270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1e05d6ca-0a4d-471f-b7a7-f938689418c7 None None] MFA Rules not processed for user `57eebea8e2f6424d805d9b84c222b222`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:20.097477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1e05d6ca-0a4d-471f-b7a7-f938689418c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:20.106587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 679/1353] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 14:47:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:20.286580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=72 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:21.759994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3b489-a82a-49a4-8d29-2a1c3e1be1f2 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:21.760628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3b489-a82a-49a4-8d29-2a1c3e1be1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:21.760628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3b489-a82a-49a4-8d29-2a1c3e1be1f2 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:21.761834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 675/1354] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 14:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:21.767340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17479826-eb56-47e3-91d7-5529f1dbf671 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:21.768217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17479826-eb56-47e3-91d7-5529f1dbf671 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:21.768671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17479826-eb56-47e3-91d7-5529f1dbf671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:21.787986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-17479826-eb56-47e3-91d7-5529f1dbf671 None None] MFA Rules not processed for user `57eebea8e2f6424d805d9b84c222b222`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:21.789183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-17479826-eb56-47e3-91d7-5529f1dbf671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:21.799851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 680/1355] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:25.708733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93f364-2db5-463f-86c9-8001784c806c None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:25.709259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93f364-2db5-463f-86c9-8001784c806c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:25.709666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93f364-2db5-463f-86c9-8001784c806c None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:25.711331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 676/1356] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:25.716646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c10a16-4d5d-4381-9965-514ec65fcab0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:25.717072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c10a16-4d5d-4381-9965-514ec65fcab0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:25.717246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c10a16-4d5d-4381-9965-514ec65fcab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:25.738403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-98c10a16-4d5d-4381-9965-514ec65fcab0 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:25.739800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-98c10a16-4d5d-4381-9965-514ec65fcab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:25.747881 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 681/1357] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:25.810510 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49e3ce-d75e-4cc6-8c13-235b43921f63 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:25.813328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49e3ce-d75e-4cc6-8c13-235b43921f63 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:25.814234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49e3ce-d75e-4cc6-8c13-235b43921f63 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:25.820984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 677/1358] 10.222.0.81 () {54 vars in 961 bytes} [Thu Jun 16 14:47:25 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:25.830706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfdb63-323f-4177-acfa-b710701f1cde None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:25.831010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfdb63-323f-4177-acfa-b710701f1cde None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:25.831505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfdb63-323f-4177-acfa-b710701f1cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:25.890729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2dcfdb63-323f-4177-acfa-b710701f1cde None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:25.892289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2dcfdb63-323f-4177-acfa-b710701f1cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:25.991243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 682/1359] 10.222.0.81 () {58 vars in 1058 bytes} [Thu Jun 16 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:26.000696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49e3ce-d75e-4cc6-8c13-235b43921f63 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:26.016999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49e3ce-d75e-4cc6-8c13-235b43921f63 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:26.023336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d05e8-af14-42e3-ae63-95c771117cb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:26.024823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d05e8-af14-42e3-ae63-95c771117cb4 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:26.025391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d05e8-af14-42e3-ae63-95c771117cb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:26.025823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d05e8-af14-42e3-ae63-95c771117cb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:26.035923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d05e8-af14-42e3-ae63-95c771117cb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:26.037751 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d05e8-af14-42e3-ae63-95c771117cb4 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:26.049310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 678/1360] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:47:28.417932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca50ae5-5148-42e7-9ef5-72aade01d697 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:28.418534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca50ae5-5148-42e7-9ef5-72aade01d697 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:28.418534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca50ae5-5148-42e7-9ef5-72aade01d697 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:28.419913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 683/1361] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:28.426457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f770562-f387-4aca-bdb7-edaf74c9fc08 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:28.427041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f770562-f387-4aca-bdb7-edaf74c9fc08 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:28.427041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f770562-f387-4aca-bdb7-edaf74c9fc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:28.446905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4f770562-f387-4aca-bdb7-edaf74c9fc08 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:28.448191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4f770562-f387-4aca-bdb7-edaf74c9fc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:28.462006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 679/1362] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:28.504548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca50ae5-5148-42e7-9ef5-72aade01d697 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:28.523415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca50ae5-5148-42e7-9ef5-72aade01d697 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:28.529084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1e032-4f0d-4c0a-b7ff-21a5e0548503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:28.530551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1e032-4f0d-4c0a-b7ff-21a5e0548503 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:28.531073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1e032-4f0d-4c0a-b7ff-21a5e0548503 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:28.531455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1e032-4f0d-4c0a-b7ff-21a5e0548503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:28.541945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1e032-4f0d-4c0a-b7ff-21a5e0548503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:28.543823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1e032-4f0d-4c0a-b7ff-21a5e0548503 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:28.554708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 684/1363] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:31.037069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad196c-98d0-4951-be74-7af6470b308d None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:31.037590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad196c-98d0-4951-be74-7af6470b308d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:31.037710 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad196c-98d0-4951-be74-7af6470b308d None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:31.039169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 680/1364] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:31.044373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5932-047a-4cc0-8a73-c2b56f5c9c13 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:31.044792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5932-047a-4cc0-8a73-c2b56f5c9c13 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:31.045047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5932-047a-4cc0-8a73-c2b56f5c9c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:31.063801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b09d5932-047a-4cc0-8a73-c2b56f5c9c13 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:31.064984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b09d5932-047a-4cc0-8a73-c2b56f5c9c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:31.075389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 685/1365] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:31.120474 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0b30-f5e8-48db-b931-92d3bb97afbc None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:31.120835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0b30-f5e8-48db-b931-92d3bb97afbc None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:31.121176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0b30-f5e8-48db-b931-92d3bb97afbc None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:31.122779 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 681/1366] 10.222.0.81 () {54 vars in 961 bytes} [Thu Jun 16 14:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:31.128791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dac28-8528-4e4a-a4df-0a10bf634f48 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:31.129084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dac28-8528-4e4a-a4df-0a10bf634f48 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:31.129368 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dac28-8528-4e4a-a4df-0a10bf634f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:31.151575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-011dac28-8528-4e4a-a4df-0a10bf634f48 None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:31.152790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-011dac28-8528-4e4a-a4df-0a10bf634f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:31.167970 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 686/1367] 10.222.0.81 () {58 vars in 1058 bytes} [Thu Jun 16 14:47:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:31.179274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a0b30-f5e8-48db-b931-92d3bb97afbc None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:31.192158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a0b30-f5e8-48db-b931-92d3bb97afbc None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:31.197686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4add0e5-7c3a-4c2e-a32b-fc9f50cb1484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:31.198359 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4add0e5-7c3a-4c2e-a32b-fc9f50cb1484 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:31.198638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4add0e5-7c3a-4c2e-a32b-fc9f50cb1484 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:31.198913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4add0e5-7c3a-4c2e-a32b-fc9f50cb1484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:31.208750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4add0e5-7c3a-4c2e-a32b-fc9f50cb1484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:31.210367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4add0e5-7c3a-4c2e-a32b-fc9f50cb1484 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:31.220487 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 682/1368] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:33.457513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d62d3a-4b03-4aad-a886-6469badb253b None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:33.458079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d62d3a-4b03-4aad-a886-6469badb253b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:33.458079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d62d3a-4b03-4aad-a886-6469badb253b None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:33.459470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 687/1369] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:33.464708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6c575-c807-4785-8d9a-413f0143a95f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:33.465189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6c575-c807-4785-8d9a-413f0143a95f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:33.465282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6c575-c807-4785-8d9a-413f0143a95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:33.483628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b3a6c575-c807-4785-8d9a-413f0143a95f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:33.484920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b3a6c575-c807-4785-8d9a-413f0143a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:33.493118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 683/1370] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:33.538163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d62d3a-4b03-4aad-a886-6469badb253b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:33.553988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d62d3a-4b03-4aad-a886-6469badb253b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:33.559450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6d256-70ea-4bb4-bfe0-7144a9ebb549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:33.560103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d256-70ea-4bb4-bfe0-7144a9ebb549 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:33.560388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d256-70ea-4bb4-bfe0-7144a9ebb549 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:33.560665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d256-70ea-4bb4-bfe0-7144a9ebb549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:33.570428 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6d256-70ea-4bb4-bfe0-7144a9ebb549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:33.571897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6d256-70ea-4bb4-bfe0-7144a9ebb549 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:33.582439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 688/1371] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:33.978985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a088-85c6-482b-936b-92e6c8804f75 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:33.979276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a088-85c6-482b-936b-92e6c8804f75 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:33.979729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a088-85c6-482b-936b-92e6c8804f75 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:33.981297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 684/1372] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:33.987543 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e88f6-5557-4fce-b0a7-cf81a2ca9cbd None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:33.987831 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e88f6-5557-4fce-b0a7-cf81a2ca9cbd None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:33.988136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e88f6-5557-4fce-b0a7-cf81a2ca9cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:34.007310 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-303e88f6-5557-4fce-b0a7-cf81a2ca9cbd None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:34.008775 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-303e88f6-5557-4fce-b0a7-cf81a2ca9cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:34.017343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 689/1373] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:34.328550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd1b8a-c2f9-4421-814d-2d777e3c387e None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:34.328913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd1b8a-c2f9-4421-814d-2d777e3c387e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:34.329263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd1b8a-c2f9-4421-814d-2d777e3c387e None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:34.330908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 685/1374] 10.222.0.81 () {54 vars in 963 bytes} [Thu Jun 16 14:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:34.336152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8b2c2-d572-41f6-a348-717286f4fbb8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:34.336451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8b2c2-d572-41f6-a348-717286f4fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:34.336731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8b2c2-d572-41f6-a348-717286f4fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:34.345999 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:34.392033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-bbd8b2c2-d572-41f6-a348-717286f4fbb8 None None] MFA Rules not processed for user `c41347251cac48c3a2ee7fa6d2fe4cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:34.393237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bbd8b2c2-d572-41f6-a348-717286f4fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:34.457300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 690/1375] 10.222.0.81 () {58 vars in 1060 bytes} [Thu Jun 16 14:47:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:34.464864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd1b8a-c2f9-4421-814d-2d777e3c387e None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:34.477476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd1b8a-c2f9-4421-814d-2d777e3c387e None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:34.481233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294349d-cab7-4b95-803d-789ee17a9cbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:34.481998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294349d-cab7-4b95-803d-789ee17a9cbd service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:34.482369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294349d-cab7-4b95-803d-789ee17a9cbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:34.482716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294349d-cab7-4b95-803d-789ee17a9cbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:34.492804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294349d-cab7-4b95-803d-789ee17a9cbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:34.494377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294349d-cab7-4b95-803d-789ee17a9cbd service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:34.504983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 686/1376] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:47:35.807945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc231-ca29-478c-a69d-cf684dd9c395 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:35.808548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc231-ca29-478c-a69d-cf684dd9c395 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:35.808548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc231-ca29-478c-a69d-cf684dd9c395 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:35.809920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 691/1377] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:35.815927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeed316-43cc-40ff-a858-ab7838fb834e None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:35.816421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeed316-43cc-40ff-a858-ab7838fb834e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:35.816421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeed316-43cc-40ff-a858-ab7838fb834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:35.835471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-feeed316-43cc-40ff-a858-ab7838fb834e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:35.836684 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-feeed316-43cc-40ff-a858-ab7838fb834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:35.845728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 687/1378] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:35.890435 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cc231-ca29-478c-a69d-cf684dd9c395 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:35.906187 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cc231-ca29-478c-a69d-cf684dd9c395 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:35.912951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf52f0-7944-4421-9941-d44e564ea2d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:35.913796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf52f0-7944-4421-9941-d44e564ea2d7 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:35.914132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf52f0-7944-4421-9941-d44e564ea2d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:35.914413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf52f0-7944-4421-9941-d44e564ea2d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:35.923676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf52f0-7944-4421-9941-d44e564ea2d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:35.925282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf52f0-7944-4421-9941-d44e564ea2d7 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:35.934974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 692/1379] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:38.207145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a2e24-98ed-492c-b120-b028a53d52da None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:38.207681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a2e24-98ed-492c-b120-b028a53d52da None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:38.207681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a2e24-98ed-492c-b120-b028a53d52da None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:38.209146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 688/1380] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:38.214478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287221d-4686-4baa-bffc-e7392f9294f1 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:38.214860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287221d-4686-4baa-bffc-e7392f9294f1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:38.215083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287221d-4686-4baa-bffc-e7392f9294f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:38.234098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c287221d-4686-4baa-bffc-e7392f9294f1 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:38.235205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c287221d-4686-4baa-bffc-e7392f9294f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:38.243283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 693/1381] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:38.288588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a2e24-98ed-492c-b120-b028a53d52da None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:38.305111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a2e24-98ed-492c-b120-b028a53d52da None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:38.312011 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01ad4d-c166-4755-8200-3e891fe7c2dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:38.312661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01ad4d-c166-4755-8200-3e891fe7c2dc service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:38.312946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01ad4d-c166-4755-8200-3e891fe7c2dc service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:38.313221 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01ad4d-c166-4755-8200-3e891fe7c2dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:38.324100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01ad4d-c166-4755-8200-3e891fe7c2dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:38.325693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01ad4d-c166-4755-8200-3e891fe7c2dc service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:38.336559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 689/1382] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:40.555817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a559e3d-fe83-4773-a13f-227b489a0c9c None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:40.556281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a559e3d-fe83-4773-a13f-227b489a0c9c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:40.556359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a559e3d-fe83-4773-a13f-227b489a0c9c None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:40.557725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 694/1383] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:40.563956 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceed3a-737d-4862-a945-1e3e9fa1970f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:40.564578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceed3a-737d-4862-a945-1e3e9fa1970f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:40.564578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceed3a-737d-4862-a945-1e3e9fa1970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:40.583404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-04ceed3a-737d-4862-a945-1e3e9fa1970f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:40.584728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-04ceed3a-737d-4862-a945-1e3e9fa1970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:40.594118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 690/1384] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:40.637912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a559e3d-fe83-4773-a13f-227b489a0c9c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:40.659117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a559e3d-fe83-4773-a13f-227b489a0c9c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:40.665674 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa6e3f-6ccf-456e-aea3-f42cd973b2d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:40.666364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa6e3f-6ccf-456e-aea3-f42cd973b2d5 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:40.666643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa6e3f-6ccf-456e-aea3-f42cd973b2d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:40.667676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa6e3f-6ccf-456e-aea3-f42cd973b2d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:40.678372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa6e3f-6ccf-456e-aea3-f42cd973b2d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:40.680161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa6e3f-6ccf-456e-aea3-f42cd973b2d5 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:40.690888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 695/1385] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:42.854535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8f65e-3ba5-45cd-9709-20dd9c67180f None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:42.855240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8f65e-3ba5-45cd-9709-20dd9c67180f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:42.855240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8f65e-3ba5-45cd-9709-20dd9c67180f None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:42.856437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 691/1386] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:42.862263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39af1-616a-4d4e-ad0b-8c1c3f04a34a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:42.862731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39af1-616a-4d4e-ad0b-8c1c3f04a34a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:42.862923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39af1-616a-4d4e-ad0b-8c1c3f04a34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:42.887037 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a8e39af1-616a-4d4e-ad0b-8c1c3f04a34a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:42.888447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a8e39af1-616a-4d4e-ad0b-8c1c3f04a34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:42.900004 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 696/1387] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:42.955385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8f65e-3ba5-45cd-9709-20dd9c67180f None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:42.970859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8f65e-3ba5-45cd-9709-20dd9c67180f None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:42.976541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f392c7e-71e6-422d-8a0f-ae469b219bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:42.977190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392c7e-71e6-422d-8a0f-ae469b219bfa service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:42.977479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392c7e-71e6-422d-8a0f-ae469b219bfa service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:42.977753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392c7e-71e6-422d-8a0f-ae469b219bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:42.987161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f392c7e-71e6-422d-8a0f-ae469b219bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:42.988802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f392c7e-71e6-422d-8a0f-ae469b219bfa service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:42.998471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 692/1388] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:45.222241 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929897-1158-47fe-a979-28a3f89cfb10 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:45.222778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929897-1158-47fe-a979-28a3f89cfb10 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:45.222980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929897-1158-47fe-a979-28a3f89cfb10 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:45.224860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 697/1389] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:45.230718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80e0c-4632-4ea0-aced-81d5c3f695fd None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:45.231143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80e0c-4632-4ea0-aced-81d5c3f695fd None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:45.231471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80e0c-4632-4ea0-aced-81d5c3f695fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:45.255981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-2ee80e0c-4632-4ea0-aced-81d5c3f695fd None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:45.257575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2ee80e0c-4632-4ea0-aced-81d5c3f695fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:45.268358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 693/1390] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:45.315373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929897-1158-47fe-a979-28a3f89cfb10 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:45.334020 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929897-1158-47fe-a979-28a3f89cfb10 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:45.339821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de228d-6381-4fe3-9a93-cc041f0d62ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:45.340509 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de228d-6381-4fe3-9a93-cc041f0d62ab service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:45.340802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de228d-6381-4fe3-9a93-cc041f0d62ab service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:45.341088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de228d-6381-4fe3-9a93-cc041f0d62ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:45.350762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de228d-6381-4fe3-9a93-cc041f0d62ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:45.352428 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de228d-6381-4fe3-9a93-cc041f0d62ab service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:45.363205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 698/1391] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:47.612263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2d43-6a65-44b1-80c4-c67d8db466ac None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:47.612810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2d43-6a65-44b1-80c4-c67d8db466ac None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:47.612968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2d43-6a65-44b1-80c4-c67d8db466ac None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:47.614811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 694/1392] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:47.620181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bb9a2-a0ea-48db-976b-663d37e17d25 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:47.620586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bb9a2-a0ea-48db-976b-663d37e17d25 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:47.620742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bb9a2-a0ea-48db-976b-663d37e17d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:47.642709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7d4bb9a2-a0ea-48db-976b-663d37e17d25 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:47.644591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7d4bb9a2-a0ea-48db-976b-663d37e17d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:47.657925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 699/1393] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:47.699737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b2d43-6a65-44b1-80c4-c67d8db466ac None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:47.716531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b2d43-6a65-44b1-80c4-c67d8db466ac None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:47.723267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1106e-9b76-492f-a3ec-11c3de7e9b7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:47.724104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1106e-9b76-492f-a3ec-11c3de7e9b7b service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:47.724399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1106e-9b76-492f-a3ec-11c3de7e9b7b service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:47.724729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1106e-9b76-492f-a3ec-11c3de7e9b7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:47.734381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1106e-9b76-492f-a3ec-11c3de7e9b7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:47.735959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1106e-9b76-492f-a3ec-11c3de7e9b7b service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:47.746618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 695/1394] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:49.994533 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35c13c-b8fc-4461-b579-fe22f04bfb8a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:49.995094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35c13c-b8fc-4461-b579-fe22f04bfb8a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:49.995094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35c13c-b8fc-4461-b579-fe22f04bfb8a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:49.996456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 700/1395] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:50.002444 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144404c-2e5e-4bbc-b982-42729f32b5b5 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:50.002889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144404c-2e5e-4bbc-b982-42729f32b5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:50.002983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144404c-2e5e-4bbc-b982-42729f32b5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:50.021232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-1144404c-2e5e-4bbc-b982-42729f32b5b5 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:50.022464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1144404c-2e5e-4bbc-b982-42729f32b5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:50.031078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 696/1396] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:50.076993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35c13c-b8fc-4461-b579-fe22f04bfb8a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:50.092021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35c13c-b8fc-4461-b579-fe22f04bfb8a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:50.103967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aa8aa-f847-4744-95de-b0bb35ea4259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:50.104629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa8aa-f847-4744-95de-b0bb35ea4259 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:50.104911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa8aa-f847-4744-95de-b0bb35ea4259 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:50.105185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa8aa-f847-4744-95de-b0bb35ea4259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:50.115433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9aa8aa-f847-4744-95de-b0bb35ea4259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:50.117014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9aa8aa-f847-4744-95de-b0bb35ea4259 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:50.126700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 701/1397] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:50.314743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf1961-9631-46b7-984a-44fa6fb803f0 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:50.314947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf1961-9631-46b7-984a-44fa6fb803f0 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:50.315301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf1961-9631-46b7-984a-44fa6fb803f0 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:50.316712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 697/1398] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:50.322625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51a3fc-ea30-4e9f-bafa-e58f827d175d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:50.322917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51a3fc-ea30-4e9f-bafa-e58f827d175d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:50.323197 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51a3fc-ea30-4e9f-bafa-e58f827d175d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:50.344224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1a51a3fc-ea30-4e9f-bafa-e58f827d175d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:50.345499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1a51a3fc-ea30-4e9f-bafa-e58f827d175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:50.353539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 702/1399] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:50.411606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3d9d-73a4-476c-81ca-276624dcc674 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:50.411979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3d9d-73a4-476c-81ca-276624dcc674 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:50.412331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3d9d-73a4-476c-81ca-276624dcc674 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:50.413781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 698/1400] 10.222.0.81 () {54 vars in 962 bytes} [Thu Jun 16 14:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:50.418896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7deb0d-fdbc-42b6-a6da-9b60f43fd6bd None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:50.419185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7deb0d-fdbc-42b6-a6da-9b60f43fd6bd None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:50.419457 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7deb0d-fdbc-42b6-a6da-9b60f43fd6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:50.467639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7e7deb0d-fdbc-42b6-a6da-9b60f43fd6bd None None] MFA Rules not processed for user `cb9c1cc51e544c90a629feb312a80c71`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:50.470451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7e7deb0d-fdbc-42b6-a6da-9b60f43fd6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:50.503731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:50.534261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 703/1401] 10.222.0.81 () {58 vars in 1059 bytes} [Thu Jun 16 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:50.541948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c3d9d-73a4-476c-81ca-276624dcc674 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:50.547550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=55 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:50.555382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c3d9d-73a4-476c-81ca-276624dcc674 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:50.559375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a7cac-c178-4196-8761-bb03b4312a61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9c1cc51e544c90a629feb312a80c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:50.560016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7cac-c178-4196-8761-bb03b4312a61 service glance] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:50.560292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7cac-c178-4196-8761-bb03b4312a61 service glance] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:50.560560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7cac-c178-4196-8761-bb03b4312a61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:50.570813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a7cac-c178-4196-8761-bb03b4312a61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:50.572171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a7cac-c178-4196-8761-bb03b4312a61 service glance] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:50.582671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 699/1402] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:47:51.309039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518538-2efc-4074-9381-802dba5ac4cc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:51.309639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518538-2efc-4074-9381-802dba5ac4cc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:51.309954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518538-2efc-4074-9381-802dba5ac4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:51.369347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-18518538-2efc-4074-9381-802dba5ac4cc None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:51.370599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-18518538-2efc-4074-9381-802dba5ac4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:51.435515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 704/1403] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 14:47:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:51.480902 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4cb6-2a84-4088-ab8b-33ae2abe99c6 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:51.481357 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4cb6-2a84-4088-ab8b-33ae2abe99c6 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:51.481451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4cb6-2a84-4088-ab8b-33ae2abe99c6 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:51.482792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 700/1404] 10.222.0.81 () {54 vars in 942 bytes} [Thu Jun 16 14:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:51.489077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cd605-683b-496d-8931-160dc9bccbc9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:51.489365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cd605-683b-496d-8931-160dc9bccbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:51.489639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cd605-683b-496d-8931-160dc9bccbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:51.538536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-769cd605-683b-496d-8931-160dc9bccbc9 None None] MFA Rules not processed for user `c0e6fc45641f4c279def2d4aa971978d`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:51.539752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-769cd605-683b-496d-8931-160dc9bccbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:51.610953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 705/1405] 10.222.0.81 () {58 vars in 1039 bytes} [Thu Jun 16 14:47:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:47:51.620195 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee4cb6-2a84-4088-ab8b-33ae2abe99c6 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:51.634611 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee4cb6-2a84-4088-ab8b-33ae2abe99c6 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:51.639981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6599dc-8ad2-4019-8265-baa5affbb309 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:51.640624 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6599dc-8ad2-4019-8265-baa5affbb309 service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:51.640906 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6599dc-8ad2-4019-8265-baa5affbb309 service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:51.641181 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6599dc-8ad2-4019-8265-baa5affbb309 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:51.649331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6599dc-8ad2-4019-8265-baa5affbb309 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:51.650955 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6599dc-8ad2-4019-8265-baa5affbb309 service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:51.661593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 701/1406] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 14:47:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 14:47:52.376790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575975e-3298-4187-b037-387012de1540 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:52.377355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575975e-3298-4187-b037-387012de1540 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:52.377355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575975e-3298-4187-b037-387012de1540 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:52.379030 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 706/1407] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:52.384783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b7f3-57d7-4962-b242-d0a9fc1bda8f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:52.385098 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b7f3-57d7-4962-b242-d0a9fc1bda8f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:52.385372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b7f3-57d7-4962-b242-d0a9fc1bda8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:52.408582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-0031b7f3-57d7-4962-b242-d0a9fc1bda8f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:52.409813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0031b7f3-57d7-4962-b242-d0a9fc1bda8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:52.425934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 702/1408] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:52.466730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575975e-3298-4187-b037-387012de1540 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:52.488619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575975e-3298-4187-b037-387012de1540 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:52.494286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703b9d8-5594-4023-95ec-c1c18296b510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:52.494940 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703b9d8-5594-4023-95ec-c1c18296b510 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:52.495221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703b9d8-5594-4023-95ec-c1c18296b510 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:52.495495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703b9d8-5594-4023-95ec-c1c18296b510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:52.504846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703b9d8-5594-4023-95ec-c1c18296b510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:52.506786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703b9d8-5594-4023-95ec-c1c18296b510 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:52.512119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:52.520391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 707/1409] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:02.402494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=14 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:13.995258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c61b2-9887-408a-8dc7-5fe18116d509 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:13.995937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c61b2-9887-408a-8dc7-5fe18116d509 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:13.995937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c61b2-9887-408a-8dc7-5fe18116d509 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:13.997192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 703/1410] 10.222.0.81 () {54 vars in 918 bytes} [Thu Jun 16 14:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:14.002896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5e570-f7e8-43ce-81c3-13ea3ae71e27 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:14.003355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5e570-f7e8-43ce-81c3-13ea3ae71e27 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:14.003564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5e570-f7e8-43ce-81c3-13ea3ae71e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:14.022222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-80c5e570-f7e8-43ce-81c3-13ea3ae71e27 None None] MFA Rules not processed for user `57eebea8e2f6424d805d9b84c222b222`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:14.023432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-80c5e570-f7e8-43ce-81c3-13ea3ae71e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:14.032016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 708/1411] 10.222.0.81 () {58 vars in 1015 bytes} [Thu Jun 16 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:14.045917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bad9ca-37d4-41af-af25-98e9fd228d3e None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:14.046839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bad9ca-37d4-41af-af25-98e9fd228d3e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:14.047141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bad9ca-37d4-41af-af25-98e9fd228d3e None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:14.048509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 704/1412] 10.222.0.81 () {54 vars in 918 bytes} [Thu Jun 16 14:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:14.053114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05ab0-fa5a-4eaf-a435-3256d075a553 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:14.053397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05ab0-fa5a-4eaf-a435-3256d075a553 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:14.053673 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05ab0-fa5a-4eaf-a435-3256d075a553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:14.073197 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d9d05ab0-fa5a-4eaf-a435-3256d075a553 None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:14.074448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d9d05ab0-fa5a-4eaf-a435-3256d075a553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:14.084948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 709/1413] 10.222.0.81 () {58 vars in 1015 bytes} [Thu Jun 16 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:48:16.685068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ce97-c530-47f9-90e8-1269b7dcb820 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:16.685627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ce97-c530-47f9-90e8-1269b7dcb820 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:16.685627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ce97-c530-47f9-90e8-1269b7dcb820 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:16.687167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:16.692589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526d3b-ffea-45da-ba04-6c15fd813b3d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:16.693047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526d3b-ffea-45da-ba04-6c15fd813b3d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:16.693143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526d3b-ffea-45da-ba04-6c15fd813b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:16.711818 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-bf526d3b-ffea-45da-ba04-6c15fd813b3d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:16.713100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bf526d3b-ffea-45da-ba04-6c15fd813b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:16.721472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:48:16.764022 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9ce97-c530-47f9-90e8-1269b7dcb820 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:16.779051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9ce97-c530-47f9-90e8-1269b7dcb820 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:16.785486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13279cd1-ed41-4556-857e-bd7b464c8e53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:16.786190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279cd1-ed41-4556-857e-bd7b464c8e53 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:16.786476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279cd1-ed41-4556-857e-bd7b464c8e53 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:16.786748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279cd1-ed41-4556-857e-bd7b464c8e53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:16.794945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13279cd1-ed41-4556-857e-bd7b464c8e53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:16.796584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13279cd1-ed41-4556-857e-bd7b464c8e53 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:16.807254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 706/1416] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:17.781538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ef278-3898-4faf-991b-166d8c0270dc None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:17.782164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ef278-3898-4faf-991b-166d8c0270dc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:17.782525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ef278-3898-4faf-991b-166d8c0270dc None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:17.784865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:48:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:48:17.790153 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66adad-6685-4c47-8973-d0eb9c50f1a9 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:17.790629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66adad-6685-4c47-8973-d0eb9c50f1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:17.790739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66adad-6685-4c47-8973-d0eb9c50f1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:17.809645 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-7e66adad-6685-4c47-8973-d0eb9c50f1a9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:17.810864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7e66adad-6685-4c47-8973-d0eb9c50f1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:17.819103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:48:17.974160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ef278-3898-4faf-991b-166d8c0270dc None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:17.988627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ef278-3898-4faf-991b-166d8c0270dc None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:17.993973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707bdfd-1975-4c75-a16f-c89bfd4cc229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:17.994613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bdfd-1975-4c75-a16f-c89bfd4cc229 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:17.994897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bdfd-1975-4c75-a16f-c89bfd4cc229 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:17.995175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bdfd-1975-4c75-a16f-c89bfd4cc229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:18.003487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707bdfd-1975-4c75-a16f-c89bfd4cc229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:18.005070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707bdfd-1975-4c75-a16f-c89bfd4cc229 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:18.014952 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 712/1419] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:18.951768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6253a4-e897-41e6-97d2-6f54da4d4083 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:18.952323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6253a4-e897-41e6-97d2-6f54da4d4083 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:18.952323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6253a4-e897-41e6-97d2-6f54da4d4083 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:18.954414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:18.959545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3142-a17f-478b-917e-607c9fcfecb2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:18.959945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3142-a17f-478b-917e-607c9fcfecb2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:18.960093 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3142-a17f-478b-917e-607c9fcfecb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:18.978579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-dabb3142-a17f-478b-917e-607c9fcfecb2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:18.979761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dabb3142-a17f-478b-917e-607c9fcfecb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:18.987672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:19.140738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6253a4-e897-41e6-97d2-6f54da4d4083 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:19.154969 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6253a4-e897-41e6-97d2-6f54da4d4083 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:19.160542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec87499-9bc7-4d39-b1c7-e50ce99a8577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:19.161178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec87499-9bc7-4d39-b1c7-e50ce99a8577 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:19.161458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec87499-9bc7-4d39-b1c7-e50ce99a8577 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:19.161748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec87499-9bc7-4d39-b1c7-e50ce99a8577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:19.170227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec87499-9bc7-4d39-b1c7-e50ce99a8577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:19.171844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec87499-9bc7-4d39-b1c7-e50ce99a8577 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:19.181255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 709/1422] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:20.138182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22661-b425-4a98-9dfd-9aaf0596e4b2 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:20.138778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22661-b425-4a98-9dfd-9aaf0596e4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:20.138778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22661-b425-4a98-9dfd-9aaf0596e4b2 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:20.140705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:20.145558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a82f-0673-4089-bb09-04c16a8710bb None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:20.146018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a82f-0673-4089-bb09-04c16a8710bb None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:20.146161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a82f-0673-4089-bb09-04c16a8710bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:20.164995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-2a72a82f-0673-4089-bb09-04c16a8710bb None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:20.166249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2a72a82f-0673-4089-bb09-04c16a8710bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:20.174871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:20.328208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b22661-b425-4a98-9dfd-9aaf0596e4b2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:20.342297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b22661-b425-4a98-9dfd-9aaf0596e4b2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:20.348100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462405ff-6aed-4bec-bb89-84cb2e6b72a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:20.348731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462405ff-6aed-4bec-bb89-84cb2e6b72a6 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:20.349010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462405ff-6aed-4bec-bb89-84cb2e6b72a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:20.349282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462405ff-6aed-4bec-bb89-84cb2e6b72a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:20.357083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462405ff-6aed-4bec-bb89-84cb2e6b72a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:20.358685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462405ff-6aed-4bec-bb89-84cb2e6b72a6 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:20.367878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 715/1425] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:21.290087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524ad20-68fe-45cf-a57d-1fc7151cfaf8 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:21.290654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524ad20-68fe-45cf-a57d-1fc7151cfaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:21.290654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524ad20-68fe-45cf-a57d-1fc7151cfaf8 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:21.292021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:21.297714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f3eba-52b9-4043-9095-9385e003ae2a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:21.298223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f3eba-52b9-4043-9095-9385e003ae2a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:21.298357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f3eba-52b9-4043-9095-9385e003ae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:21.317658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e76f3eba-52b9-4043-9095-9385e003ae2a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:21.319018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e76f3eba-52b9-4043-9095-9385e003ae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:21.326968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:21.489591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524ad20-68fe-45cf-a57d-1fc7151cfaf8 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:21.504434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524ad20-68fe-45cf-a57d-1fc7151cfaf8 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:21.510134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e19bd-9bfb-4292-961f-62fd70e0afb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:21.510775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e19bd-9bfb-4292-961f-62fd70e0afb9 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:21.511058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e19bd-9bfb-4292-961f-62fd70e0afb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:21.511331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e19bd-9bfb-4292-961f-62fd70e0afb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:21.520047 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e19bd-9bfb-4292-961f-62fd70e0afb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:21.521629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e19bd-9bfb-4292-961f-62fd70e0afb9 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:21.531807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 712/1428] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:22.390814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4742577-4763-404a-86ca-7cb01136b0bc None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:22.391357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4742577-4763-404a-86ca-7cb01136b0bc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:22.391357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4742577-4763-404a-86ca-7cb01136b0bc None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:22.392835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:48:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:22.397872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c277627-2db0-4384-aa00-9326816dd3e3 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:22.398527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c277627-2db0-4384-aa00-9326816dd3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:22.398527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c277627-2db0-4384-aa00-9326816dd3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:22.416984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5c277627-2db0-4384-aa00-9326816dd3e3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:22.418261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5c277627-2db0-4384-aa00-9326816dd3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:22.427227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:22.582748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4742577-4763-404a-86ca-7cb01136b0bc None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:22.598182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4742577-4763-404a-86ca-7cb01136b0bc None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:22.603530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c268c-aa13-406f-bfe0-c809126eeffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:22.604163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c268c-aa13-406f-bfe0-c809126eeffe service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:22.604447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c268c-aa13-406f-bfe0-c809126eeffe service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:22.604723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c268c-aa13-406f-bfe0-c809126eeffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:22.613800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c268c-aa13-406f-bfe0-c809126eeffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:22.615423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c268c-aa13-406f-bfe0-c809126eeffe service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:22.625431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 718/1431] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:23.486425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4bf1-ce06-43a3-90ac-43a434bd25d1 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:23.487021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4bf1-ce06-43a3-90ac-43a434bd25d1 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:23.487021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4bf1-ce06-43a3-90ac-43a434bd25d1 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:23.488373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:23.493426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb6755-bb88-4c87-8433-c3d8e8e71552 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:23.493864 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb6755-bb88-4c87-8433-c3d8e8e71552 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:23.494014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb6755-bb88-4c87-8433-c3d8e8e71552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:23.512302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-95fb6755-bb88-4c87-8433-c3d8e8e71552 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:23.513510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-95fb6755-bb88-4c87-8433-c3d8e8e71552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:23.521518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:23.675362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e4bf1-ce06-43a3-90ac-43a434bd25d1 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:23.690098 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e4bf1-ce06-43a3-90ac-43a434bd25d1 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:23.695504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f293be-88de-44e0-aedf-7fa6e71fe4e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:23.696145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f293be-88de-44e0-aedf-7fa6e71fe4e3 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:23.696431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f293be-88de-44e0-aedf-7fa6e71fe4e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:23.696707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f293be-88de-44e0-aedf-7fa6e71fe4e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:23.705698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f293be-88de-44e0-aedf-7fa6e71fe4e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:23.707320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f293be-88de-44e0-aedf-7fa6e71fe4e3 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:23.716699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 715/1434] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:24.578309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41d8c-5836-40f6-9ee4-7f24b3ec05f0 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:24.578309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41d8c-5836-40f6-9ee4-7f24b3ec05f0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:24.579250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41d8c-5836-40f6-9ee4-7f24b3ec05f0 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:24.580260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:24.585276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a32b6-845f-420c-9f62-8fbf2bc1daf6 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:24.585699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a32b6-845f-420c-9f62-8fbf2bc1daf6 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:24.585856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a32b6-845f-420c-9f62-8fbf2bc1daf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:24.604167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-e64a32b6-845f-420c-9f62-8fbf2bc1daf6 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:24.605361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e64a32b6-845f-420c-9f62-8fbf2bc1daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:24.613594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:24.775702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d41d8c-5836-40f6-9ee4-7f24b3ec05f0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:24.790948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d41d8c-5836-40f6-9ee4-7f24b3ec05f0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:24.796283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233557cc-745a-4543-b66f-e507b86b1a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:24.797050 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233557cc-745a-4543-b66f-e507b86b1a16 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:24.797226 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233557cc-745a-4543-b66f-e507b86b1a16 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:24.797497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233557cc-745a-4543-b66f-e507b86b1a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:24.806335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233557cc-745a-4543-b66f-e507b86b1a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:24.807909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233557cc-745a-4543-b66f-e507b86b1a16 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:24.817814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 721/1437] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:25.676285 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05192d10-faeb-4604-b54c-f4571313061b None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:25.676752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05192d10-faeb-4604-b54c-f4571313061b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:25.676946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05192d10-faeb-4604-b54c-f4571313061b None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:25.678516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:48:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:25.683426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642907-1e01-487d-a2de-342f03cc9d55 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:25.683851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642907-1e01-487d-a2de-342f03cc9d55 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:25.683957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642907-1e01-487d-a2de-342f03cc9d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:25.701661 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3e642907-1e01-487d-a2de-342f03cc9d55 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:25.703290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3e642907-1e01-487d-a2de-342f03cc9d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:25.711294 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:25.862361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05192d10-faeb-4604-b54c-f4571313061b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:25.876944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05192d10-faeb-4604-b54c-f4571313061b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:25.882400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9cdef-de3d-47a4-a552-d2355c7ac301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:25.883046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9cdef-de3d-47a4-a552-d2355c7ac301 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:25.883352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9cdef-de3d-47a4-a552-d2355c7ac301 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:25.883628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9cdef-de3d-47a4-a552-d2355c7ac301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:25.893142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9cdef-de3d-47a4-a552-d2355c7ac301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:25.894742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9cdef-de3d-47a4-a552-d2355c7ac301 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:25.903923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 718/1440] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:27.910391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50227-17b6-4563-b7c0-7802bf3255a3 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:27.910962 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50227-17b6-4563-b7c0-7802bf3255a3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:27.910962 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50227-17b6-4563-b7c0-7802bf3255a3 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:27.912337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:27.917699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee25e17-3f5a-4893-bcfe-2e5cdc542e40 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:27.918162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee25e17-3f5a-4893-bcfe-2e5cdc542e40 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:27.918291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee25e17-3f5a-4893-bcfe-2e5cdc542e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:27.936014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6ee25e17-3f5a-4893-bcfe-2e5cdc542e40 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:27.937991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6ee25e17-3f5a-4893-bcfe-2e5cdc542e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:27.946629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:27.984984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50227-17b6-4563-b7c0-7802bf3255a3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:27.995795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50227-17b6-4563-b7c0-7802bf3255a3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:28.000257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd4fb4-e2c3-48e2-af97-9bcd599d1276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:28.000873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4fb4-e2c3-48e2-af97-9bcd599d1276 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:28.001150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4fb4-e2c3-48e2-af97-9bcd599d1276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:28.001421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4fb4-e2c3-48e2-af97-9bcd599d1276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:28.010627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd4fb4-e2c3-48e2-af97-9bcd599d1276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:28.012040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd4fb4-e2c3-48e2-af97-9bcd599d1276 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:28.021944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 724/1443] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:30.353579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114df2f-aed7-486f-8176-ba012e72db81 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:30.354203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114df2f-aed7-486f-8176-ba012e72db81 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:30.354203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114df2f-aed7-486f-8176-ba012e72db81 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:30.355594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:30.361568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0167d5-caab-4236-80d7-1cad3977f049 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:30.362019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0167d5-caab-4236-80d7-1cad3977f049 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:30.362161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0167d5-caab-4236-80d7-1cad3977f049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:30.379491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3b0167d5-caab-4236-80d7-1cad3977f049 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:30.380700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3b0167d5-caab-4236-80d7-1cad3977f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:30.388843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:30.427078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114df2f-aed7-486f-8176-ba012e72db81 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:30.438350 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114df2f-aed7-486f-8176-ba012e72db81 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:30.441910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a34a9e-50a7-46dd-ace8-03d410736c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:30.442549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a34a9e-50a7-46dd-ace8-03d410736c81 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:30.442832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a34a9e-50a7-46dd-ace8-03d410736c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:30.443104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a34a9e-50a7-46dd-ace8-03d410736c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:30.451962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a34a9e-50a7-46dd-ace8-03d410736c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:30.454460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a34a9e-50a7-46dd-ace8-03d410736c81 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:30.463828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 721/1446] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:32.966112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8a419-c8e6-493a-bdc7-857cbf14fdb5 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:32.966646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8a419-c8e6-493a-bdc7-857cbf14fdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:32.966646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8a419-c8e6-493a-bdc7-857cbf14fdb5 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:32.968079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:32.974249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf16e-e390-4744-9a9c-8c19af75eb37 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:32.974737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf16e-e390-4744-9a9c-8c19af75eb37 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:32.974821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf16e-e390-4744-9a9c-8c19af75eb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:32.993091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-adfdf16e-e390-4744-9a9c-8c19af75eb37 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:32.994344 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-adfdf16e-e390-4744-9a9c-8c19af75eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:33.003056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:33.041793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8a419-c8e6-493a-bdc7-857cbf14fdb5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:33.043544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dbd8a419-c8e6-493a-bdc7-857cbf14fdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:33.057034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8a419-c8e6-493a-bdc7-857cbf14fdb5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:33.060539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657d999-bd10-4cbe-9153-675c36de468c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:33.061181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d999-bd10-4cbe-9153-675c36de468c service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:33.061467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d999-bd10-4cbe-9153-675c36de468c service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:33.061750 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d999-bd10-4cbe-9153-675c36de468c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:33.070971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657d999-bd10-4cbe-9153-675c36de468c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:33.072389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657d999-bd10-4cbe-9153-675c36de468c service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:33.082212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 727/1449] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:35.392608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96694e12-ec75-42a7-8e65-e91f0107ead6 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:35.393140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96694e12-ec75-42a7-8e65-e91f0107ead6 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:35.393263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96694e12-ec75-42a7-8e65-e91f0107ead6 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:35.394599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:35.400019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc819-38a9-4da8-b6fd-613ef54a600b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:35.400449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc819-38a9-4da8-b6fd-613ef54a600b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:35.400560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc819-38a9-4da8-b6fd-613ef54a600b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:35.418581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a04dc819-38a9-4da8-b6fd-613ef54a600b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:35.419791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a04dc819-38a9-4da8-b6fd-613ef54a600b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:35.428326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:35.467087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96694e12-ec75-42a7-8e65-e91f0107ead6 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:35.478885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96694e12-ec75-42a7-8e65-e91f0107ead6 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:35.482424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5532eed-6473-4e38-8c95-1cd1d9dc7428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:35.483062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5532eed-6473-4e38-8c95-1cd1d9dc7428 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:35.483344 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5532eed-6473-4e38-8c95-1cd1d9dc7428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:35.483616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5532eed-6473-4e38-8c95-1cd1d9dc7428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:35.493442 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5532eed-6473-4e38-8c95-1cd1d9dc7428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:35.494912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5532eed-6473-4e38-8c95-1cd1d9dc7428 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:35.504479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 724/1452] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:37.707744 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e00533-8439-478f-9972-1988a47c3421 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:37.708293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e00533-8439-478f-9972-1988a47c3421 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:37.708293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e00533-8439-478f-9972-1988a47c3421 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:37.709678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:48:37.714879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f7b2e-eafd-49a9-9068-11b6a79b1e50 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:37.715315 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f7b2e-eafd-49a9-9068-11b6a79b1e50 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:37.715435 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f7b2e-eafd-49a9-9068-11b6a79b1e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:37.733553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-406f7b2e-eafd-49a9-9068-11b6a79b1e50 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:37.735928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-406f7b2e-eafd-49a9-9068-11b6a79b1e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:37.744042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:37.781892 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e00533-8439-478f-9972-1988a47c3421 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:37.792566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e00533-8439-478f-9972-1988a47c3421 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:37.796098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd052d51-0cca-4544-887d-6646e6d0ad24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:37.796790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052d51-0cca-4544-887d-6646e6d0ad24 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:37.797060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052d51-0cca-4544-887d-6646e6d0ad24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:37.797334 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd052d51-0cca-4544-887d-6646e6d0ad24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:37.806237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd052d51-0cca-4544-887d-6646e6d0ad24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:37.807651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd052d51-0cca-4544-887d-6646e6d0ad24 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:37.818420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 730/1455] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:40.020759 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2284a-7e2c-4b38-a6b7-c1f11f79566b None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:40.021286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2284a-7e2c-4b38-a6b7-c1f11f79566b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:40.021286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2284a-7e2c-4b38-a6b7-c1f11f79566b None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:40.022650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:40.027991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472505c6-d9bb-4770-be85-5979b0760744 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:40.028391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472505c6-d9bb-4770-be85-5979b0760744 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:40.028556 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472505c6-d9bb-4770-be85-5979b0760744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:40.047542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-472505c6-d9bb-4770-be85-5979b0760744 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:40.048787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-472505c6-d9bb-4770-be85-5979b0760744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:40.056535 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:40.094966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2284a-7e2c-4b38-a6b7-c1f11f79566b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:40.105643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2284a-7e2c-4b38-a6b7-c1f11f79566b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:40.110379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37fab9-3666-4594-a38d-b898c4ba5cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:40.111026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37fab9-3666-4594-a38d-b898c4ba5cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:40.111312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37fab9-3666-4594-a38d-b898c4ba5cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:40.111586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37fab9-3666-4594-a38d-b898c4ba5cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:40.120592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37fab9-3666-4594-a38d-b898c4ba5cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:40.122062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37fab9-3666-4594-a38d-b898c4ba5cf0 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:40.133376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 727/1458] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:42.427508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975dc5-a645-4832-8216-3d810519457c None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:42.428042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975dc5-a645-4832-8216-3d810519457c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:42.428042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975dc5-a645-4832-8216-3d810519457c None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:42.429423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:42.434602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783954e-e20d-48df-8562-efc740f3d918 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:42.435022 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783954e-e20d-48df-8562-efc740f3d918 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:42.435156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783954e-e20d-48df-8562-efc740f3d918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:42.441766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=70 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:42.455055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5783954e-e20d-48df-8562-efc740f3d918 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:42.456241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5783954e-e20d-48df-8562-efc740f3d918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:42.463882 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:42.502109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00975dc5-a645-4832-8216-3d810519457c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:42.513426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00975dc5-a645-4832-8216-3d810519457c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:42.517370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192fe6b-8a8a-4002-855f-e8fd85a0ad60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:42.518056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192fe6b-8a8a-4002-855f-e8fd85a0ad60 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:42.518361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192fe6b-8a8a-4002-855f-e8fd85a0ad60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:42.518659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192fe6b-8a8a-4002-855f-e8fd85a0ad60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:42.524942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=75 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:42.529590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192fe6b-8a8a-4002-855f-e8fd85a0ad60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:42.531152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192fe6b-8a8a-4002-855f-e8fd85a0ad60 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:42.541118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 733/1461] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:44.703195 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801dfc6-a02f-400f-9e75-cdb802f668e0 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:44.703913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801dfc6-a02f-400f-9e75-cdb802f668e0 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:44.703913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801dfc6-a02f-400f-9e75-cdb802f668e0 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:44.705130 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:44.710429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a869a2-ce4e-4f79-a994-e658af53df84 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:44.710889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a869a2-ce4e-4f79-a994-e658af53df84 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:44.711014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a869a2-ce4e-4f79-a994-e658af53df84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:44.728590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f2a869a2-ce4e-4f79-a994-e658af53df84 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:44.729791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f2a869a2-ce4e-4f79-a994-e658af53df84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:44.738242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:44.775807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801dfc6-a02f-400f-9e75-cdb802f668e0 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:44.786775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801dfc6-a02f-400f-9e75-cdb802f668e0 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:44.790284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d32a02-95a2-48eb-a6c5-88c1a12fcfee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:44.790927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d32a02-95a2-48eb-a6c5-88c1a12fcfee service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:44.791209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d32a02-95a2-48eb-a6c5-88c1a12fcfee service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:44.791484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d32a02-95a2-48eb-a6c5-88c1a12fcfee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:44.800954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d32a02-95a2-48eb-a6c5-88c1a12fcfee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:44.802458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d32a02-95a2-48eb-a6c5-88c1a12fcfee service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:44.811839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 730/1464] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:46.994417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381733f-1daa-421d-8216-25bb77812326 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:46.994940 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381733f-1daa-421d-8216-25bb77812326 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:46.994940 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381733f-1daa-421d-8216-25bb77812326 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:46.996285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:47.002046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63c7d-55a3-40d8-998a-37d11c7e07b0 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:47.002512 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63c7d-55a3-40d8-998a-37d11c7e07b0 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:47.002628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63c7d-55a3-40d8-998a-37d11c7e07b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:47.020761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-24d63c7d-55a3-40d8-998a-37d11c7e07b0 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:47.021999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-24d63c7d-55a3-40d8-998a-37d11c7e07b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:47.029699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:47.067706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381733f-1daa-421d-8216-25bb77812326 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:47.079511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381733f-1daa-421d-8216-25bb77812326 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:47.083226 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156583a-4465-4ca2-a524-d577e603fb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:47.083884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156583a-4465-4ca2-a524-d577e603fb43 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:47.084171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156583a-4465-4ca2-a524-d577e603fb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:47.084439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156583a-4465-4ca2-a524-d577e603fb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:47.094338 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156583a-4465-4ca2-a524-d577e603fb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:47.095840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156583a-4465-4ca2-a524-d577e603fb43 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:47.105549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 736/1467] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:49.345548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deca7b-828c-4c3c-8af0-a12d7053a4f4 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:49.346148 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deca7b-828c-4c3c-8af0-a12d7053a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:49.346148 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deca7b-828c-4c3c-8af0-a12d7053a4f4 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:49.347514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:49.352747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9d66-38b0-4497-8f10-b7d2763d844f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:49.353143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9d66-38b0-4497-8f10-b7d2763d844f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:49.353298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9d66-38b0-4497-8f10-b7d2763d844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:49.372018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-373e9d66-38b0-4497-8f10-b7d2763d844f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:49.373222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-373e9d66-38b0-4497-8f10-b7d2763d844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:49.382394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:49.419170 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deca7b-828c-4c3c-8af0-a12d7053a4f4 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:49.431147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deca7b-828c-4c3c-8af0-a12d7053a4f4 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:49.434776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3a6bf-73d9-48eb-950d-051bdc78989a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:49.435415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3a6bf-73d9-48eb-950d-051bdc78989a service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:49.435696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3a6bf-73d9-48eb-950d-051bdc78989a service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:49.435971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3a6bf-73d9-48eb-950d-051bdc78989a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:49.445530 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3a6bf-73d9-48eb-950d-051bdc78989a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:49.446990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3a6bf-73d9-48eb-950d-051bdc78989a service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:49.456466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 733/1470] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:59.366896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=15 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:59.452129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=17 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:09.762288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7160a6-0097-4f26-ab2b-b58e13ffb03a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:09.762842 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7160a6-0097-4f26-ab2b-b58e13ffb03a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:09.762956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7160a6-0097-4f26-ab2b-b58e13ffb03a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:09.764311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 738/1471] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:09.769996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bd10e-8e67-4214-aa51-80cea866bcec None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:09.770488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bd10e-8e67-4214-aa51-80cea866bcec None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:09.770622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bd10e-8e67-4214-aa51-80cea866bcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:09.789450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6a7bd10e-8e67-4214-aa51-80cea866bcec None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:09.790690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6a7bd10e-8e67-4214-aa51-80cea866bcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:09.799644 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 734/1472] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:09.846733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c783473-f618-4a7b-9c2b-971154fe083e None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:09.847023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c783473-f618-4a7b-9c2b-971154fe083e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:09.847303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c783473-f618-4a7b-9c2b-971154fe083e None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:09.848678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 739/1473] 10.222.0.81 () {54 vars in 962 bytes} [Thu Jun 16 14:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:09.853516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1bf9e-594d-4057-b410-b0e1be58d974 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:09.853826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1bf9e-594d-4057-b410-b0e1be58d974 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:09.854150 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1bf9e-594d-4057-b410-b0e1be58d974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:09.872343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-16d1bf9e-594d-4057-b410-b0e1be58d974 None None] MFA Rules not processed for user `cb9c1cc51e544c90a629feb312a80c71`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:09.873523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-16d1bf9e-594d-4057-b410-b0e1be58d974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:09.880187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 735/1474] 10.222.0.81 () {58 vars in 1059 bytes} [Thu Jun 16 14:49:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:09.887540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c783473-f618-4a7b-9c2b-971154fe083e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:09.898375 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c783473-f618-4a7b-9c2b-971154fe083e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:09.901912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337c68f-1b69-4254-91ad-458305415207 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9c1cc51e544c90a629feb312a80c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:09.902545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337c68f-1b69-4254-91ad-458305415207 service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:09.902827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337c68f-1b69-4254-91ad-458305415207 service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:09.903099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337c68f-1b69-4254-91ad-458305415207 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:09.913051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337c68f-1b69-4254-91ad-458305415207 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:09.914514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337c68f-1b69-4254-91ad-458305415207 service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:09.924794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 740/1475] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:49:12.204659 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0759-4cc1-4786-ad49-c4024d1e61f2 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:12.205229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0759-4cc1-4786-ad49-c4024d1e61f2 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:12.205229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0759-4cc1-4786-ad49-c4024d1e61f2 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:12.206678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 736/1476] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:12.211990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b568-92c1-4c0e-b9bb-4fbc7e5a8ab9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:12.212379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b568-92c1-4c0e-b9bb-4fbc7e5a8ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:12.212553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b568-92c1-4c0e-b9bb-4fbc7e5a8ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:12.230845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-23b4b568-92c1-4c0e-b9bb-4fbc7e5a8ab9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:12.232032 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-23b4b568-92c1-4c0e-b9bb-4fbc7e5a8ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:12.240648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 741/1477] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:12.263982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0759-4cc1-4786-ad49-c4024d1e61f2 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:12.276465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0759-4cc1-4786-ad49-c4024d1e61f2 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:12.281396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6d0b9-b95d-42fb-a989-7b92df374e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:12.282070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6d0b9-b95d-42fb-a989-7b92df374e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:12.282347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6d0b9-b95d-42fb-a989-7b92df374e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:12.282617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6d0b9-b95d-42fb-a989-7b92df374e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:12.283339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6d0b9-b95d-42fb-a989-7b92df374e8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:12.285107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: WARNING py.warnings [None req-03b6d0b9-b95d-42fb-a989-7b92df374e8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:49:12.285107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: warnings.warn(msg) Jun 16 14:49:12.285107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: Jun 16 14:49:12.286261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6d0b9-b95d-42fb-a989-7b92df374e8d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:12.305690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 737/1478] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Jun 16 14:49:12 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:49:14.453769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40847b8-9329-4806-b32a-026af8f59332 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:14.454536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40847b8-9329-4806-b32a-026af8f59332 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:14.454536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40847b8-9329-4806-b32a-026af8f59332 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:14.455702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 742/1479] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:49:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:14.460880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded8e71-77c7-4808-8820-9e0f047db1c2 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:14.461289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded8e71-77c7-4808-8820-9e0f047db1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:14.461443 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded8e71-77c7-4808-8820-9e0f047db1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:14.479525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4ded8e71-77c7-4808-8820-9e0f047db1c2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:14.480738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4ded8e71-77c7-4808-8820-9e0f047db1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:14.489040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 738/1480] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:14.531821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40847b8-9329-4806-b32a-026af8f59332 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:14.547128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40847b8-9329-4806-b32a-026af8f59332 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:14.552536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bd081-dcf4-4c6d-ad95-31b9fe699eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:14.553174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd081-dcf4-4c6d-ad95-31b9fe699eb5 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:14.553458 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd081-dcf4-4c6d-ad95-31b9fe699eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:14.553736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd081-dcf4-4c6d-ad95-31b9fe699eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:14.561764 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bd081-dcf4-4c6d-ad95-31b9fe699eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:14.563962 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bd081-dcf4-4c6d-ad95-31b9fe699eb5 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:14.573312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 743/1481] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:16.868698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d0cca-5d3b-46ac-89d0-8beb6ed92023 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:16.869270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d0cca-5d3b-46ac-89d0-8beb6ed92023 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:16.869270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d0cca-5d3b-46ac-89d0-8beb6ed92023 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:16.870649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 739/1482] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:16.875806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331fd97-df45-4926-95a5-10961a60733b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:16.876243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331fd97-df45-4926-95a5-10961a60733b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:16.876392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331fd97-df45-4926-95a5-10961a60733b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:16.895403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9331fd97-df45-4926-95a5-10961a60733b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:16.896610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9331fd97-df45-4926-95a5-10961a60733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:16.904537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 744/1483] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:16.941717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d0cca-5d3b-46ac-89d0-8beb6ed92023 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:16.952389 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d0cca-5d3b-46ac-89d0-8beb6ed92023 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:16.956993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36c857-bec9-4c1f-bacd-ca10a356c567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:16.957633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c857-bec9-4c1f-bacd-ca10a356c567 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:16.957937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c857-bec9-4c1f-bacd-ca10a356c567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:16.958215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c857-bec9-4c1f-bacd-ca10a356c567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:16.967106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36c857-bec9-4c1f-bacd-ca10a356c567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:16.969434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36c857-bec9-4c1f-bacd-ca10a356c567 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:16.978416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 740/1484] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:19.235582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5768-a999-4e86-b41a-e6e13ebe3e14 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:19.236925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5768-a999-4e86-b41a-e6e13ebe3e14 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:19.236925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5768-a999-4e86-b41a-e6e13ebe3e14 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:19.238418 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 745/1485] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:49:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:19.243930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31907e3f-e119-435e-aa9c-4fb218c39060 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:19.244364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31907e3f-e119-435e-aa9c-4fb218c39060 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:19.244467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31907e3f-e119-435e-aa9c-4fb218c39060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:19.263370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-31907e3f-e119-435e-aa9c-4fb218c39060 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:19.264564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-31907e3f-e119-435e-aa9c-4fb218c39060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:19.272393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 741/1486] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:19.310198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f5768-a999-4e86-b41a-e6e13ebe3e14 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:19.322117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f5768-a999-4e86-b41a-e6e13ebe3e14 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:19.326911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a2ee-9fca-4ec7-a813-1da14f97ebf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:19.327699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a2ee-9fca-4ec7-a813-1da14f97ebf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:19.328144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a2ee-9fca-4ec7-a813-1da14f97ebf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:19.328623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a2ee-9fca-4ec7-a813-1da14f97ebf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:19.341517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a2ee-9fca-4ec7-a813-1da14f97ebf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:19.342988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a2ee-9fca-4ec7-a813-1da14f97ebf3 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:19.353234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 746/1487] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:21.568719 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ac227-269a-495b-b70f-9eeeb6d88e79 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:21.569321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ac227-269a-495b-b70f-9eeeb6d88e79 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:21.569321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ac227-269a-495b-b70f-9eeeb6d88e79 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:21.570705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 742/1488] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:21.575728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f020-db9a-41e0-bd03-286467dfecf9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:21.576134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f020-db9a-41e0-bd03-286467dfecf9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:21.576278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f020-db9a-41e0-bd03-286467dfecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:21.593998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3b32f020-db9a-41e0-bd03-286467dfecf9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:21.595140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3b32f020-db9a-41e0-bd03-286467dfecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:21.602805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 747/1489] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:21.643349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ac227-269a-495b-b70f-9eeeb6d88e79 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:21.654264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ac227-269a-495b-b70f-9eeeb6d88e79 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:21.658705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c696e-bd5f-4c4f-857c-4090600242e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:21.659350 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c696e-bd5f-4c4f-857c-4090600242e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:21.659638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c696e-bd5f-4c4f-857c-4090600242e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:21.659911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c696e-bd5f-4c4f-857c-4090600242e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:21.669261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c696e-bd5f-4c4f-857c-4090600242e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:21.670731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c696e-bd5f-4c4f-857c-4090600242e2 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:21.681491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 743/1490] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:24.122972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca762834-b582-49a1-a393-7762ea627d21 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:24.123501 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca762834-b582-49a1-a393-7762ea627d21 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:24.123626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca762834-b582-49a1-a393-7762ea627d21 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:24.125445 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 748/1491] 10.222.0.81 () {54 vars in 926 bytes} [Thu Jun 16 14:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:24.130835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c40bb1-6361-4e05-9280-9d406ce96cf3 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:24.131293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c40bb1-6361-4e05-9280-9d406ce96cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:24.131418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c40bb1-6361-4e05-9280-9d406ce96cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:24.150396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-e6c40bb1-6361-4e05-9280-9d406ce96cf3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:24.151650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e6c40bb1-6361-4e05-9280-9d406ce96cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:24.159845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 744/1492] 10.222.0.81 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:24.198259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca762834-b582-49a1-a393-7762ea627d21 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:24.213475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca762834-b582-49a1-a393-7762ea627d21 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:24.216989 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcc132-a824-44e1-bd4a-821854bc8151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:24.217622 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcc132-a824-44e1-bd4a-821854bc8151 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:24.217922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcc132-a824-44e1-bd4a-821854bc8151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:24.218309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcc132-a824-44e1-bd4a-821854bc8151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:24.227380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcc132-a824-44e1-bd4a-821854bc8151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:24.228784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcc132-a824-44e1-bd4a-821854bc8151 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:24.238040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 749/1493] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:34.145068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=33 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:34.233789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=33 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:50.329448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552333fb-e7f5-4c91-90bd-5cd3a3636dd0 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.330309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552333fb-e7f5-4c91-90bd-5cd3a3636dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.330309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552333fb-e7f5-4c91-90bd-5cd3a3636dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.348289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-552333fb-e7f5-4c91-90bd-5cd3a3636dd0 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:50.349467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-552333fb-e7f5-4c91-90bd-5cd3a3636dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:50.357228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 745/1494] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:50.367099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa79f7-ad10-42f8-b4c2-e2d413f1a872 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.367605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa79f7-ad10-42f8-b4c2-e2d413f1a872 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.367714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa79f7-ad10-42f8-b4c2-e2d413f1a872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.386060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a8aa79f7-ad10-42f8-b4c2-e2d413f1a872 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:50.387261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a8aa79f7-ad10-42f8-b4c2-e2d413f1a872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:50.396045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 750/1495] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:50.400616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552333fb-e7f5-4c91-90bd-5cd3a3636dd0 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:50.411431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552333fb-e7f5-4c91-90bd-5cd3a3636dd0 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:50.416061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665606-0138-4ddd-995d-9357703dcf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:50.416718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665606-0138-4ddd-995d-9357703dcf10 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.417003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665606-0138-4ddd-995d-9357703dcf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.417281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665606-0138-4ddd-995d-9357703dcf10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.418050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5665606-0138-4ddd-995d-9357703dcf10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:50:50.418365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5665606-0138-4ddd-995d-9357703dcf10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:50.419374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: WARNING py.warnings [None req-f5665606-0138-4ddd-995d-9357703dcf10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:50:50.419374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: warnings.warn(msg) Jun 16 14:50:50.419374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: Jun 16 14:50:50.420265 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5665606-0138-4ddd-995d-9357703dcf10 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:50.432599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 746/1496] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:50:50.440937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa79f7-ad10-42f8-b4c2-e2d413f1a872 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:50.450038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa79f7-ad10-42f8-b4c2-e2d413f1a872 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:50.454915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5ecfd-4ea6-485a-a0bd-6338040a7575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:50.455565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ecfd-4ea6-485a-a0bd-6338040a7575 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.455851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ecfd-4ea6-485a-a0bd-6338040a7575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.456130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ecfd-4ea6-485a-a0bd-6338040a7575 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.456817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5ecfd-4ea6-485a-a0bd-6338040a7575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:50.458648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: WARNING py.warnings [None req-a8a5ecfd-4ea6-485a-a0bd-6338040a7575 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:50:50.458648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: warnings.warn(msg) Jun 16 14:50:50.458648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: Jun 16 14:50:50.459834 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5ecfd-4ea6-485a-a0bd-6338040a7575 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:50.496201 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 751/1497] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:50:50 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:50:50.500550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665606-0138-4ddd-995d-9357703dcf10 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:50.510515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665606-0138-4ddd-995d-9357703dcf10 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:50.570215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c1471-c0cf-4239-b576-3d1ee2916319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:50.570887 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1471-c0cf-4239-b576-3d1ee2916319 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.571169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1471-c0cf-4239-b576-3d1ee2916319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.571448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1471-c0cf-4239-b576-3d1ee2916319 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.572136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c1471-c0cf-4239-b576-3d1ee2916319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:50.573154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: WARNING py.warnings [None req-ce6c1471-c0cf-4239-b576-3d1ee2916319 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:50:50.573154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: warnings.warn(msg) Jun 16 14:50:50.573154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: Jun 16 14:50:50.574383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c1471-c0cf-4239-b576-3d1ee2916319 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:50.595120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 747/1498] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:50:50 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:50:50.599248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5ecfd-4ea6-485a-a0bd-6338040a7575 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:50.610604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5ecfd-4ea6-485a-a0bd-6338040a7575 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:50.615229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9cf4e-a3ef-4698-b314-9d79bbacd5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:50.615957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9cf4e-a3ef-4698-b314-9d79bbacd5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.616174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9cf4e-a3ef-4698-b314-9d79bbacd5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.616452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9cf4e-a3ef-4698-b314-9d79bbacd5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.617165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9cf4e-a3ef-4698-b314-9d79bbacd5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:50.618205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: WARNING py.warnings [None req-81a9cf4e-a3ef-4698-b314-9d79bbacd5d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:50:50.618205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: warnings.warn(msg) Jun 16 14:50:50.618205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: Jun 16 14:50:50.619076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9cf4e-a3ef-4698-b314-9d79bbacd5d4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:50.632310 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 752/1499] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:50:50.636527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c1471-c0cf-4239-b576-3d1ee2916319 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:50.647501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c1471-c0cf-4239-b576-3d1ee2916319 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:50.652115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b898b5c-2ae7-49fe-84c0-9a36a0905824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:50.652774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b898b5c-2ae7-49fe-84c0-9a36a0905824 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.653054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b898b5c-2ae7-49fe-84c0-9a36a0905824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.653324 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b898b5c-2ae7-49fe-84c0-9a36a0905824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.654063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b898b5c-2ae7-49fe-84c0-9a36a0905824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:50.655116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: WARNING py.warnings [None req-4b898b5c-2ae7-49fe-84c0-9a36a0905824 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:50:50.655116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: warnings.warn(msg) Jun 16 14:50:50.655116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: Jun 16 14:50:50.657109 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b898b5c-2ae7-49fe-84c0-9a36a0905824 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:50.672095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 748/1500] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:50:50.676240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9cf4e-a3ef-4698-b314-9d79bbacd5d4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:50.686057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9cf4e-a3ef-4698-b314-9d79bbacd5d4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:50.692980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ad264-db53-46ed-b10b-07ad46c8c210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:50.693865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ad264-db53-46ed-b10b-07ad46c8c210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.694172 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ad264-db53-46ed-b10b-07ad46c8c210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.694443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ad264-db53-46ed-b10b-07ad46c8c210 admin admin] PATH_INFO: `/v3/projects/f90bc79ceba24025a96e87c142fd3e85/users/2f6878ed84994e8fb21418cdeea01df6/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.710246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ad264-db53-46ed-b10b-07ad46c8c210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90bc79ceba24025a96e87c142fd3e85, user_id=2f6878ed84994e8fb21418cdeea01df6, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:50.711286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: WARNING py.warnings [None req-958ad264-db53-46ed-b10b-07ad46c8c210 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:50:50.711286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: warnings.warn(msg) Jun 16 14:50:50.711286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: Jun 16 14:50:50.713182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ad264-db53-46ed-b10b-07ad46c8c210 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:50.727986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 753/1501] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:50:50 2022] PUT /identity/v3/projects/f90bc79ceba24025a96e87c142fd3e85/users/2f6878ed84994e8fb21418cdeea01df6/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:50:50.739686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cdfb4-7972-41df-855b-86c8373b1efc None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.739994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cdfb4-7972-41df-855b-86c8373b1efc None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.740258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cdfb4-7972-41df-855b-86c8373b1efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.766893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-735cdfb4-7972-41df-855b-86c8373b1efc None None] MFA Rules not processed for user `2f6878ed84994e8fb21418cdeea01df6`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:50.768102 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-735cdfb4-7972-41df-855b-86c8373b1efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:50.833401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 749/1502] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:50.846612 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aa288-91e5-487b-aca1-f74f507bedca None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.846862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aa288-91e5-487b-aca1-f74f507bedca None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.847139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aa288-91e5-487b-aca1-f74f507bedca None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.848572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 754/1503] 10.222.0.81 () {54 vars in 963 bytes} [Thu Jun 16 14:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:50.853325 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdab29-6416-4c96-9164-5a40f9112752 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.853616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdab29-6416-4c96-9164-5a40f9112752 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.853905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdab29-6416-4c96-9164-5a40f9112752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.872138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-38bdab29-6416-4c96-9164-5a40f9112752 None None] MFA Rules not processed for user `c41347251cac48c3a2ee7fa6d2fe4cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:50.873352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-38bdab29-6416-4c96-9164-5a40f9112752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:50.917908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:50.926918 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 750/1504] 10.222.0.81 () {58 vars in 1060 bytes} [Thu Jun 16 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:50.934551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7aa288-91e5-487b-aca1-f74f507bedca None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:50.945710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7aa288-91e5-487b-aca1-f74f507bedca None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:50.949237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415caf-daa4-449f-8f9c-8ae13a353282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:50.949870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415caf-daa4-449f-8f9c-8ae13a353282 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.950178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415caf-daa4-449f-8f9c-8ae13a353282 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.950449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415caf-daa4-449f-8f9c-8ae13a353282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.959009 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89415caf-daa4-449f-8f9c-8ae13a353282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:50.960441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89415caf-daa4-449f-8f9c-8ae13a353282 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:50.969793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 755/1505] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:51.010968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce908bc-e37c-4605-935a-69a15c31b8ff None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:51.011257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce908bc-e37c-4605-935a-69a15c31b8ff None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:51.011533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce908bc-e37c-4605-935a-69a15c31b8ff None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:51.012861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 751/1506] 10.222.0.81 () {52 vars in 829 bytes} [Thu Jun 16 14:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:51.016798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415caf-daa4-449f-8f9c-8ae13a353282 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:51.081221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415caf-daa4-449f-8f9c-8ae13a353282 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:51.085813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:51.086713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:51.086997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:51.087276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] PATH_INFO: `/v3/users/2f6878ed84994e8fb21418cdeea01df6` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:51.088464 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6878ed84994e8fb21418cdeea01df6)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:51.089477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: WARNING py.warnings [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:50:51.089477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: warnings.warn(msg) Jun 16 14:50:51.089477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: Jun 16 14:50:51.090724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:51.154236 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6878ed84994e8fb21418cdeea01df6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:50:51.155530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6878ed84994e8fb21418cdeea01df6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:50:51.156244 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6878ed84994e8fb21418cdeea01df6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:50:51.168432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6878ed84994e8fb21418cdeea01df6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:50:51.178684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6878ed84994e8fb21418cdeea01df6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:50:51.194941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:51.204551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 756/1507] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:50:51 2022] DELETE /identity/v3/users/2f6878ed84994e8fb21418cdeea01df6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:50:51.209084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de69bbe-09be-449e-82a8-bebd2114d661 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:51.209372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de69bbe-09be-449e-82a8-bebd2114d661 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:51.209645 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de69bbe-09be-449e-82a8-bebd2114d661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:51.227362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-7de69bbe-09be-449e-82a8-bebd2114d661 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:51.228541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7de69bbe-09be-449e-82a8-bebd2114d661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:51.286833 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 752/1508] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:50:51.296868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:51.298306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:51.360470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b82c1-d0b6-46fd-a2e6-6a2b7a5f6f91 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:51.364111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79c909-2b72-4a51-9293-917898c9efb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:51.364765 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c909-2b72-4a51-9293-917898c9efb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:51.365052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c909-2b72-4a51-9293-917898c9efb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:51.365331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c909-2b72-4a51-9293-917898c9efb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:51.375027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79c909-2b72-4a51-9293-917898c9efb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:51.376499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79c909-2b72-4a51-9293-917898c9efb9 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:51.386300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 757/1509] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:51.749528 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de69bbe-09be-449e-82a8-bebd2114d661 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:51.751194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7de69bbe-09be-449e-82a8-bebd2114d661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:51.763326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de69bbe-09be-449e-82a8-bebd2114d661 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:51.768307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:51.769134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:51.769413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:51.769913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] PATH_INFO: `/v3/projects/f90bc79ceba24025a96e87c142fd3e85` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:51.771023 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90bc79ceba24025a96e87c142fd3e85)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:51.772045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: WARNING py.warnings [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:50:51.772045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: warnings.warn(msg) Jun 16 14:50:51.772045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: Jun 16 14:50:51.774512 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:51.845449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90bc79ceba24025a96e87c142fd3e85', 'request_id': 'req-34e8503a-baa6-42f5-b28b-c59b465502ab'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:50:51.855186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90bc79ceba24025a96e87c142fd3e85', 'request_id': 'req-34e8503a-baa6-42f5-b28b-c59b465502ab'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:50:51.869236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90bc79ceba24025a96e87c142fd3e85', 'request_id': 'req-34e8503a-baa6-42f5-b28b-c59b465502ab'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:50:51.881354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] The token cache is being invalidate because project f90bc79ceba24025a96e87c142fd3e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:50:51.881643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:50:51.882450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-34e8503a-baa6-42f5-b28b-c59b465502ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:50:51.884035 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 753/1510] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:50:51 2022] DELETE /identity/v3/projects/f90bc79ceba24025a96e87c142fd3e85 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:51:01.382030 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:01.877288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:49.990965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19705e-e13c-4128-b6ad-a76a6c3da184 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:49.991554 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19705e-e13c-4128-b6ad-a76a6c3da184 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:49.991554 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19705e-e13c-4128-b6ad-a76a6c3da184 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:49.992936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:52:49.998042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d6a8f-480b-471b-a574-f6c9e3a73ac3 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:49.998504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d6a8f-480b-471b-a574-f6c9e3a73ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:49.998597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d6a8f-480b-471b-a574-f6c9e3a73ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:50.017605 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-7a8d6a8f-480b-471b-a574-f6c9e3a73ac3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:52:50.018852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7a8d6a8f-480b-471b-a574-f6c9e3a73ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:52:50.077959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:52:50.250776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19705e-e13c-4128-b6ad-a76a6c3da184 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:50.252479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-df19705e-e13c-4128-b6ad-a76a6c3da184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:52:50.331211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19705e-e13c-4128-b6ad-a76a6c3da184 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:50.336609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354986a2-b701-40d2-98b1-3416124935cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:50.337260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354986a2-b701-40d2-98b1-3416124935cf service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:50.337545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354986a2-b701-40d2-98b1-3416124935cf service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:50.337822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354986a2-b701-40d2-98b1-3416124935cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:50.346027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354986a2-b701-40d2-98b1-3416124935cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:50.347708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354986a2-b701-40d2-98b1-3416124935cf service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:50.357143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 759/1513] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:52:51.261397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f05ebb-d4fe-4bfa-ad8a-c432de923cd5 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:51.261974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f05ebb-d4fe-4bfa-ad8a-c432de923cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:51.261974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f05ebb-d4fe-4bfa-ad8a-c432de923cd5 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:51.263367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:52:51.268409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf0308-9719-4f86-ad65-f8996958c3af None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:51.268828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf0308-9719-4f86-ad65-f8996958c3af None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:51.268954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf0308-9719-4f86-ad65-f8996958c3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:51.287575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-13cf0308-9719-4f86-ad65-f8996958c3af None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:52:51.288786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-13cf0308-9719-4f86-ad65-f8996958c3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:52:51.296545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:52:51.456257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f05ebb-d4fe-4bfa-ad8a-c432de923cd5 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:51.472258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f05ebb-d4fe-4bfa-ad8a-c432de923cd5 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:51.478784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd87e20-39c3-41c6-85f5-e6ef549227e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:51.479418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd87e20-39c3-41c6-85f5-e6ef549227e7 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:51.479701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd87e20-39c3-41c6-85f5-e6ef549227e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:51.479982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd87e20-39c3-41c6-85f5-e6ef549227e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:51.488287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd87e20-39c3-41c6-85f5-e6ef549227e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:51.490448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd87e20-39c3-41c6-85f5-e6ef549227e7 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:51.500312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 756/1516] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:52:53.865634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e9f05-84be-41d5-9242-76ce56952867 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:53.866201 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e9f05-84be-41d5-9242-76ce56952867 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:53.866319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e9f05-84be-41d5-9242-76ce56952867 None None] PATH_INFO: `/v3` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:53.867570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 761/1517] 10.222.0.90 () {54 vars in 925 bytes} [Thu Jun 16 14:52:53 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:52:53.876524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811261c-5b16-4cf8-a7ba-b0effd803fad None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:53.876970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811261c-5b16-4cf8-a7ba-b0effd803fad None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:53.877073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811261c-5b16-4cf8-a7ba-b0effd803fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:53.896133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-9811261c-5b16-4cf8-a7ba-b0effd803fad None None] MFA Rules not processed for user `57eebea8e2f6424d805d9b84c222b222`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:52:53.897351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9811261c-5b16-4cf8-a7ba-b0effd803fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:52:53.960594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 757/1518] 10.222.0.90 () {58 vars in 1015 bytes} [Thu Jun 16 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:53:01.281617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=37 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:02.782383 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71c94-d72c-42ce-86d0-e0b577467035 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:02.783057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71c94-d72c-42ce-86d0-e0b577467035 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:02.783057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71c94-d72c-42ce-86d0-e0b577467035 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:02.784470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 762/1519] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:53:02.790268 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ea587-07c7-4918-9f72-a358eec52849 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:02.790721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ea587-07c7-4918-9f72-a358eec52849 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:02.790848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ea587-07c7-4918-9f72-a358eec52849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:02.811092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-961ea587-07c7-4918-9f72-a358eec52849 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:53:02.812310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-961ea587-07c7-4918-9f72-a358eec52849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:02.820222 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 758/1520] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:53:02.978118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab71c94-d72c-42ce-86d0-e0b577467035 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:53:02.993006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab71c94-d72c-42ce-86d0-e0b577467035 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:53:02.998306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c4fe3-8d4c-4059-85b0-d9615477bca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:53:02.998943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4fe3-8d4c-4059-85b0-d9615477bca2 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:02.999227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4fe3-8d4c-4059-85b0-d9615477bca2 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:02.999503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4fe3-8d4c-4059-85b0-d9615477bca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:03.008157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c4fe3-8d4c-4059-85b0-d9615477bca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:53:03.009734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c4fe3-8d4c-4059-85b0-d9615477bca2 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:53:03.019453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 763/1521] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:53:03.893452 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba1a1d-6381-4fd8-ab6d-d2eea8e67942 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:03.894079 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba1a1d-6381-4fd8-ab6d-d2eea8e67942 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:03.894079 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba1a1d-6381-4fd8-ab6d-d2eea8e67942 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:03.895551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:53:03.900665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30140-2ddf-412a-9f7b-f06cf32ea858 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:03.901127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30140-2ddf-412a-9f7b-f06cf32ea858 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:03.901245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30140-2ddf-412a-9f7b-f06cf32ea858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:03.919341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fca30140-2ddf-412a-9f7b-f06cf32ea858 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:53:03.920470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fca30140-2ddf-412a-9f7b-f06cf32ea858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:03.929299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:53:04.084294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba1a1d-6381-4fd8-ab6d-d2eea8e67942 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:53:04.101384 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba1a1d-6381-4fd8-ab6d-d2eea8e67942 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:53:04.106847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae704b-8360-4362-a361-d6d291bd48c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:53:04.107495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae704b-8360-4362-a361-d6d291bd48c9 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:04.107780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae704b-8360-4362-a361-d6d291bd48c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:04.108063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae704b-8360-4362-a361-d6d291bd48c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:04.119658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae704b-8360-4362-a361-d6d291bd48c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:53:04.122080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae704b-8360-4362-a361-d6d291bd48c9 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:53:04.131880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 760/1524] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:53:05.798074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e85ec6-9035-4226-959e-7b4d860e0ae1 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:05.798548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e85ec6-9035-4226-959e-7b4d860e0ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:05.798548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e85ec6-9035-4226-959e-7b4d860e0ae1 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:05.799951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 765/1525] 10.222.0.81 () {54 vars in 960 bytes} [Thu Jun 16 14:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:53:05.805701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d536-df81-4fe2-91a2-bb8f18dfa8e8 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:05.806230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d536-df81-4fe2-91a2-bb8f18dfa8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:05.806348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d536-df81-4fe2-91a2-bb8f18dfa8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:05.824795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-86c4d536-df81-4fe2-91a2-bb8f18dfa8e8 None None] MFA Rules not processed for user `57eebea8e2f6424d805d9b84c222b222`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:53:05.826041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-86c4d536-df81-4fe2-91a2-bb8f18dfa8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:05.835604 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 761/1526] 10.222.0.81 () {58 vars in 1057 bytes} [Thu Jun 16 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:53:05.843027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e85ec6-9035-4226-959e-7b4d860e0ae1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:53:05.856656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e85ec6-9035-4226-959e-7b4d860e0ae1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:53:05.861857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305db70f-60e6-4498-acf1-207105765784 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:53:05.862540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305db70f-60e6-4498-acf1-207105765784 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:05.862809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305db70f-60e6-4498-acf1-207105765784 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:05.863086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305db70f-60e6-4498-acf1-207105765784 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:05.872046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305db70f-60e6-4498-acf1-207105765784 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:53:05.873623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305db70f-60e6-4498-acf1-207105765784 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:53:05.883939 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 766/1527] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:53:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:53:15.419197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aed2f-3d4a-4a82-b9c2-35b862af060e None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:15.419769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aed2f-3d4a-4a82-b9c2-35b862af060e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:15.419769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aed2f-3d4a-4a82-b9c2-35b862af060e None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:15.421131 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:53:15.426013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62a0eb-9d24-4107-86e9-363b58ed6b81 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:15.426438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62a0eb-9d24-4107-86e9-363b58ed6b81 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:15.426586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62a0eb-9d24-4107-86e9-363b58ed6b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:15.444885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-0d62a0eb-9d24-4107-86e9-363b58ed6b81 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:53:15.446133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0d62a0eb-9d24-4107-86e9-363b58ed6b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:15.454180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:53:15.610038 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7aed2f-3d4a-4a82-b9c2-35b862af060e None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:53:15.619864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=75 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:15.626610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7aed2f-3d4a-4a82-b9c2-35b862af060e None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:53:15.633083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44804-46f1-48d0-b6fa-628e78b3a5cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:53:15.633728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44804-46f1-48d0-b6fa-628e78b3a5cb service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:15.634051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44804-46f1-48d0-b6fa-628e78b3a5cb service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:15.634328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44804-46f1-48d0-b6fa-628e78b3a5cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:15.642653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44804-46f1-48d0-b6fa-628e78b3a5cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:53:15.644242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44804-46f1-48d0-b6fa-628e78b3a5cb service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:53:15.653975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 763/1530] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:53:16.529390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6b70-d5ba-46ef-b059-d81a783c2f8c None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:16.529972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6b70-d5ba-46ef-b059-d81a783c2f8c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:16.529972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6b70-d5ba-46ef-b059-d81a783c2f8c None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:16.531363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:53:16.536863 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8b284-5bf1-4e68-8f81-f538a268cd36 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:16.537314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8b284-5bf1-4e68-8f81-f538a268cd36 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:16.537534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8b284-5bf1-4e68-8f81-f538a268cd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:16.555320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d2f8b284-5bf1-4e68-8f81-f538a268cd36 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:53:16.556524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d2f8b284-5bf1-4e68-8f81-f538a268cd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:16.565332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:53:16.718063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb6b70-d5ba-46ef-b059-d81a783c2f8c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:53:16.732803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb6b70-d5ba-46ef-b059-d81a783c2f8c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:53:16.738149 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70781170-2904-4295-832b-079b45865938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:53:16.738722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781170-2904-4295-832b-079b45865938 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:16.739033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781170-2904-4295-832b-079b45865938 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:16.739300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781170-2904-4295-832b-079b45865938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:16.747628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70781170-2904-4295-832b-079b45865938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:53:16.749202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70781170-2904-4295-832b-079b45865938 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:53:16.759147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 769/1533] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:53:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:53:21.427468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fbc3e-29e8-4e50-a0ca-56fe8eebd8f7 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:21.428063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fbc3e-29e8-4e50-a0ca-56fe8eebd8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:21.428063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fbc3e-29e8-4e50-a0ca-56fe8eebd8f7 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:21.429407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:53:21.434660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076b48a-896d-4ddd-9e7d-e595a6f6db83 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:21.435062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076b48a-896d-4ddd-9e7d-e595a6f6db83 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:21.435221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076b48a-896d-4ddd-9e7d-e595a6f6db83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:21.454061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-0076b48a-896d-4ddd-9e7d-e595a6f6db83 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:53:21.455272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0076b48a-896d-4ddd-9e7d-e595a6f6db83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:21.463829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:53:21.500396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fbc3e-29e8-4e50-a0ca-56fe8eebd8f7 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:53:21.502138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e33fbc3e-29e8-4e50-a0ca-56fe8eebd8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:21.559635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fbc3e-29e8-4e50-a0ca-56fe8eebd8f7 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:53:21.563296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d4b10-5082-4b8f-b267-511b466df279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:53:21.563932 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d4b10-5082-4b8f-b267-511b466df279 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:21.564211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d4b10-5082-4b8f-b267-511b466df279 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:21.564482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d4b10-5082-4b8f-b267-511b466df279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:21.573867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d4b10-5082-4b8f-b267-511b466df279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:53:21.575310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d4b10-5082-4b8f-b267-511b466df279 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:53:21.585282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 766/1536] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:53:23.785089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759b537-c4d6-4342-bd74-11ffa9b7f64b None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:23.785516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759b537-c4d6-4342-bd74-11ffa9b7f64b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:23.786495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759b537-c4d6-4342-bd74-11ffa9b7f64b None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:23.787906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:53:23.793418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb834a7-f2d7-4e37-bb9f-98a2c73acdb8 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:23.793858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb834a7-f2d7-4e37-bb9f-98a2c73acdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:23.793987 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb834a7-f2d7-4e37-bb9f-98a2c73acdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:23.812740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-fbb834a7-f2d7-4e37-bb9f-98a2c73acdb8 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:53:23.813975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-fbb834a7-f2d7-4e37-bb9f-98a2c73acdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:23.822158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:53:23.859230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759b537-c4d6-4342-bd74-11ffa9b7f64b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:53:23.860998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0759b537-c4d6-4342-bd74-11ffa9b7f64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:23.874714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759b537-c4d6-4342-bd74-11ffa9b7f64b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:53:23.878232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b844c-644f-4b60-90bc-29829ca80958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:53:23.878879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b844c-644f-4b60-90bc-29829ca80958 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:23.879165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b844c-644f-4b60-90bc-29829ca80958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:23.879504 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b844c-644f-4b60-90bc-29829ca80958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:23.888841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b844c-644f-4b60-90bc-29829ca80958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:53:23.890634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b844c-644f-4b60-90bc-29829ca80958 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:53:23.905322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 772/1539] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:53:27.643601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fd67f-7661-47e3-81ca-409f9d6dab2d None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:27.644154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fd67f-7661-47e3-81ca-409f9d6dab2d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:27.644154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fd67f-7661-47e3-81ca-409f9d6dab2d None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:27.645541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 768/1540] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:53:27.650926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279b81-7fb7-43a3-9783-cb601366c127 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:27.651368 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279b81-7fb7-43a3-9783-cb601366c127 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:27.651466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279b81-7fb7-43a3-9783-cb601366c127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:27.670722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-54279b81-7fb7-43a3-9783-cb601366c127 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:53:27.671916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-54279b81-7fb7-43a3-9783-cb601366c127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:27.680937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 773/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:53:27.956166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fd67f-7661-47e3-81ca-409f9d6dab2d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:53:27.957855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a63fd67f-7661-47e3-81ca-409f9d6dab2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:28.015898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fd67f-7661-47e3-81ca-409f9d6dab2d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:53:28.019434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607a8ce-a8eb-4fb3-af43-af8b87ec74a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:53:28.020102 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607a8ce-a8eb-4fb3-af43-af8b87ec74a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:28.020387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607a8ce-a8eb-4fb3-af43-af8b87ec74a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:28.020698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607a8ce-a8eb-4fb3-af43-af8b87ec74a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:28.029800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607a8ce-a8eb-4fb3-af43-af8b87ec74a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:53:28.031266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607a8ce-a8eb-4fb3-af43-af8b87ec74a8 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:53:28.041422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 769/1542] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:53:30.195380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55c4be-4bfe-4ff9-9fba-4b7dda3842de None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:30.195955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55c4be-4bfe-4ff9-9fba-4b7dda3842de None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:30.196048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55c4be-4bfe-4ff9-9fba-4b7dda3842de None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:30.197401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 774/1543] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:53:30.202489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f3037-0380-4cd4-9c5c-f71844681a13 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:30.202883 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f3037-0380-4cd4-9c5c-f71844681a13 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:30.203041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f3037-0380-4cd4-9c5c-f71844681a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:30.221399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6d9f3037-0380-4cd4-9c5c-f71844681a13 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:53:30.222632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6d9f3037-0380-4cd4-9c5c-f71844681a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:30.231114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 770/1544] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:53:30.503947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55c4be-4bfe-4ff9-9fba-4b7dda3842de None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:53:30.506408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bc55c4be-4bfe-4ff9-9fba-4b7dda3842de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:53:30.519921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55c4be-4bfe-4ff9-9fba-4b7dda3842de None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:53:30.524103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc9a89-6143-4157-8f0d-af14ca673e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:53:30.524741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9a89-6143-4157-8f0d-af14ca673e7d service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:53:30.525024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9a89-6143-4157-8f0d-af14ca673e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:53:30.525299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9a89-6143-4157-8f0d-af14ca673e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:53:30.534181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc9a89-6143-4157-8f0d-af14ca673e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:53:30.535593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc9a89-6143-4157-8f0d-af14ca673e7d service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:53:30.545031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 775/1545] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:53:40.216225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=66 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:40.540977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=42 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:21.271360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8519b-831c-4aeb-890b-7073a55aa17d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.272077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8519b-831c-4aeb-890b-7073a55aa17d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.272077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8519b-831c-4aeb-890b-7073a55aa17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.296180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5be8519b-831c-4aeb-890b-7073a55aa17d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.297791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5be8519b-831c-4aeb-890b-7073a55aa17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.316925 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 771/1546] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.333054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1ac8b-3290-4ce5-af76-f42c3496e06e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.333663 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1ac8b-3290-4ce5-af76-f42c3496e06e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.333663 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1ac8b-3290-4ce5-af76-f42c3496e06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.370823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-82b1ac8b-3290-4ce5-af76-f42c3496e06e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.372034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-82b1ac8b-3290-4ce5-af76-f42c3496e06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.389296 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 776/1547] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.395817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8519b-831c-4aeb-890b-7073a55aa17d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:21.407673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8519b-831c-4aeb-890b-7073a55aa17d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:21.418341 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c1b60-253d-46dd-88dd-123413ee4e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:21.419767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c1b60-253d-46dd-88dd-123413ee4e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.420274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c1b60-253d-46dd-88dd-123413ee4e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.420768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c1b60-253d-46dd-88dd-123413ee4e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.421749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c1b60-253d-46dd-88dd-123413ee4e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:21.422407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c1b60-253d-46dd-88dd-123413ee4e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:21.424491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c1b60-253d-46dd-88dd-123413ee4e8e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:21.444500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 772/1548] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:55:21.453390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1ac8b-3290-4ce5-af76-f42c3496e06e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:21.460165 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962facf-0d60-4148-a2bb-89266568f59d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.460852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962facf-0d60-4148-a2bb-89266568f59d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.461363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962facf-0d60-4148-a2bb-89266568f59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.469604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1ac8b-3290-4ce5-af76-f42c3496e06e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:21.478237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d09690-a7a3-421a-859b-fe1661517cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:21.478904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09690-a7a3-421a-859b-fe1661517cad admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.479191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09690-a7a3-421a-859b-fe1661517cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.479463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09690-a7a3-421a-859b-fe1661517cad admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.485907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d09690-a7a3-421a-859b-fe1661517cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:21.485907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d09690-a7a3-421a-859b-fe1661517cad admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:21.497715 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b962facf-0d60-4148-a2bb-89266568f59d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.499705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b962facf-0d60-4148-a2bb-89266568f59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.518285 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 773/1549] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:55:21.529899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0097a0-1854-4e2a-8db6-206cda187a28 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.530755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0097a0-1854-4e2a-8db6-206cda187a28 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.531246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0097a0-1854-4e2a-8db6-206cda187a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.533963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 777/1550] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:21.540497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d09690-a7a3-421a-859b-fe1661517cad admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:21.568036 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-9c0097a0-1854-4e2a-8db6-206cda187a28 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.569810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9c0097a0-1854-4e2a-8db6-206cda187a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.687152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d09690-a7a3-421a-859b-fe1661517cad admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:21.693415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7189e-0d1c-4c53-b453-6ef02c96a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:21.694532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7189e-0d1c-4c53-b453-6ef02c96a9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.695037 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7189e-0d1c-4c53-b453-6ef02c96a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.695415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7189e-0d1c-4c53-b453-6ef02c96a9b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.696203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7189e-0d1c-4c53-b453-6ef02c96a9b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:21.697497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: WARNING py.warnings [None req-8fe7189e-0d1c-4c53-b453-6ef02c96a9b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:55:21.697497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: warnings.warn(msg) Jun 16 14:55:21.697497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: Jun 16 14:55:21.699403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7189e-0d1c-4c53-b453-6ef02c96a9b0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:21.721093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 774/1551] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:55:21.723294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857dab7-0146-4534-b6ea-be0164999f3f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.723766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857dab7-0146-4534-b6ea-be0164999f3f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.724200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857dab7-0146-4534-b6ea-be0164999f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.729042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 778/1552] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:21.729042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ab3a-5ee7-4e69-b411-831248fad553 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.729042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ab3a-5ee7-4e69-b411-831248fad553 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.729390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ab3a-5ee7-4e69-b411-831248fad553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.751234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7aa0ab3a-5ee7-4e69-b411-831248fad553 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.752576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-8857dab7-0146-4534-b6ea-be0164999f3f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.752705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7aa0ab3a-5ee7-4e69-b411-831248fad553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.754370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8857dab7-0146-4534-b6ea-be0164999f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.765411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 779/1553] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.765618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 775/1554] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.765618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857dab7-0146-4534-b6ea-be0164999f3f None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:21.765780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb427-f20e-44b3-aed8-11e05d9851e0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.765780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb427-f20e-44b3-aed8-11e05d9851e0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.765780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb427-f20e-44b3-aed8-11e05d9851e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.780732 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857dab7-0146-4534-b6ea-be0164999f3f None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:21.784278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-197fb427-f20e-44b3-aed8-11e05d9851e0 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.785315 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5a47d-5115-49b4-96a8-8059803f5f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:21.785643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-197fb427-f20e-44b3-aed8-11e05d9851e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.786055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5a47d-5115-49b4-96a8-8059803f5f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.786338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5a47d-5115-49b4-96a8-8059803f5f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.786614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5a47d-5115-49b4-96a8-8059803f5f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.787371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5a47d-5115-49b4-96a8-8059803f5f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:21.789013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5a47d-5115-49b4-96a8-8059803f5f8d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:21.794647 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 780/1555] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.795458 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fb427-f20e-44b3-aed8-11e05d9851e0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:21.799893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 776/1556] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:21.801564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d6f91-6ed6-431a-84fb-678cae652923 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.802024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d6f91-6ed6-431a-84fb-678cae652923 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.802459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d6f91-6ed6-431a-84fb-678cae652923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.806648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fb427-f20e-44b3-aed8-11e05d9851e0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:21.811358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dedf4-bc37-494b-92f8-60772480d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:21.812022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dedf4-bc37-494b-92f8-60772480d656 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.812308 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dedf4-bc37-494b-92f8-60772480d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.812583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dedf4-bc37-494b-92f8-60772480d656 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.813309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dedf4-bc37-494b-92f8-60772480d656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:21.813619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dedf4-bc37-494b-92f8-60772480d656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:21.814671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: WARNING py.warnings [None req-0b2dedf4-bc37-494b-92f8-60772480d656 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:55:21.814671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: warnings.warn(msg) Jun 16 14:55:21.814671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: Jun 16 14:55:21.815552 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dedf4-bc37-494b-92f8-60772480d656 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:21.822469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c40d6f91-6ed6-431a-84fb-678cae652923 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.823678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c40d6f91-6ed6-431a-84fb-678cae652923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.827870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 781/1557] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:55:21.829099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98b436-dc5b-44f6-8ee0-869ca7321d3f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.829388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98b436-dc5b-44f6-8ee0-869ca7321d3f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.829931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98b436-dc5b-44f6-8ee0-869ca7321d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.833347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 777/1558] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.842664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6920-9143-4407-a9ca-ac94b104d1f6 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.842664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6920-9143-4407-a9ca-ac94b104d1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.842664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6920-9143-4407-a9ca-ac94b104d1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.850962 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8e98b436-dc5b-44f6-8ee0-869ca7321d3f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.853994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8e98b436-dc5b-44f6-8ee0-869ca7321d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.854320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-af8e6920-9143-4407-a9ca-ac94b104d1f6 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.855058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-af8e6920-9143-4407-a9ca-ac94b104d1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.861172 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 782/1559] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.862469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62285756-7dd4-467e-884f-bc7ad7b1c811 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.862968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62285756-7dd4-467e-884f-bc7ad7b1c811 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.863339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62285756-7dd4-467e-884f-bc7ad7b1c811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.867353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 778/1560] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.869533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae98012-21f4-4f6b-aa5a-a4cfa15519f2 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.870332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae98012-21f4-4f6b-aa5a-a4cfa15519f2 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.870926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae98012-21f4-4f6b-aa5a-a4cfa15519f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.887366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-62285756-7dd4-467e-884f-bc7ad7b1c811 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.888579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-62285756-7dd4-467e-884f-bc7ad7b1c811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.890412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3ae98012-21f4-4f6b-aa5a-a4cfa15519f2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.891647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3ae98012-21f4-4f6b-aa5a-a4cfa15519f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.898862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 783/1561] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.899783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62285756-7dd4-467e-884f-bc7ad7b1c811 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:21.910541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 779/1562] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.915628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62285756-7dd4-467e-884f-bc7ad7b1c811 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:21.915739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc25ad-c56e-445b-ad10-21361f3f97c7 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.915878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc25ad-c56e-445b-ad10-21361f3f97c7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.916159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc25ad-c56e-445b-ad10-21361f3f97c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.917326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96b191-4b0c-463f-9f77-68b1a04f03c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:21.918027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96b191-4b0c-463f-9f77-68b1a04f03c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.918309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96b191-4b0c-463f-9f77-68b1a04f03c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.918579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96b191-4b0c-463f-9f77-68b1a04f03c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.919497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96b191-4b0c-463f-9f77-68b1a04f03c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:21.921081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96b191-4b0c-463f-9f77-68b1a04f03c8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:21.933378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 784/1563] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:21.934412 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96b191-4b0c-463f-9f77-68b1a04f03c8 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:21.936658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-98fc25ad-c56e-445b-ad10-21361f3f97c7 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.937696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-98fc25ad-c56e-445b-ad10-21361f3f97c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.945202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96b191-4b0c-463f-9f77-68b1a04f03c8 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:21.946734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 780/1564] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.947975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840578ec-e742-460a-a8d5-47974210a2d9 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.948262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840578ec-e742-460a-a8d5-47974210a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.948541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840578ec-e742-460a-a8d5-47974210a2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.953268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907307eb-5eef-4f5a-95b7-8a65a1700151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:21.953937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907307eb-5eef-4f5a-95b7-8a65a1700151 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.954220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907307eb-5eef-4f5a-95b7-8a65a1700151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.954494 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907307eb-5eef-4f5a-95b7-8a65a1700151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.955173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907307eb-5eef-4f5a-95b7-8a65a1700151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:21.957972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907307eb-5eef-4f5a-95b7-8a65a1700151 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:21.967025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-840578ec-e742-460a-a8d5-47974210a2d9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.968227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-840578ec-e742-460a-a8d5-47974210a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:21.976753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 781/1565] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:21.978151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8dc67-5f07-4a86-a404-f9befe33cdbc None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:21.978448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8dc67-5f07-4a86-a404-f9befe33cdbc None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:21.978733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8dc67-5f07-4a86-a404-f9befe33cdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:21.991304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 785/1566] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:21.992339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907307eb-5eef-4f5a-95b7-8a65a1700151 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:21.998139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-daa8dc67-5f07-4a86-a404-f9befe33cdbc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:21.999347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-daa8dc67-5f07-4a86-a404-f9befe33cdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:22.042386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:22.057286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907307eb-5eef-4f5a-95b7-8a65a1700151 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.061214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 782/1567] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:22.062103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b6834-6d42-4031-ba43-bd7204287f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.062876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b6834-6d42-4031-ba43-bd7204287f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.063158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b6834-6d42-4031-ba43-bd7204287f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.063427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b6834-6d42-4031-ba43-bd7204287f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.064013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de9893-501f-47ff-89b3-3c169c20cbad None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.064132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b6834-6d42-4031-ba43-bd7204287f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:22.064308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de9893-501f-47ff-89b3-3c169c20cbad None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.064471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b6834-6d42-4031-ba43-bd7204287f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.064587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de9893-501f-47ff-89b3-3c169c20cbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.067030 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b6834-6d42-4031-ba43-bd7204287f91 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.078608 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 786/1568] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:55:22.079506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b6834-6d42-4031-ba43-bd7204287f91 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.086977 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-07de9893-501f-47ff-89b3-3c169c20cbad None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:22.088257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-07de9893-501f-47ff-89b3-3c169c20cbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:22.090632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b6834-6d42-4031-ba43-bd7204287f91 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.095078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15fdea-a715-45af-aa06-5c10ceb4de1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.095836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15fdea-a715-45af-aa06-5c10ceb4de1c admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.096119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15fdea-a715-45af-aa06-5c10ceb4de1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.096391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15fdea-a715-45af-aa06-5c10ceb4de1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.096482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 783/1569] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:22.097326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15fdea-a715-45af-aa06-5c10ceb4de1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:22.097447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de9893-501f-47ff-89b3-3c169c20cbad None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.097620 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15fdea-a715-45af-aa06-5c10ceb4de1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.099237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15fdea-a715-45af-aa06-5c10ceb4de1c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.106924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de9893-501f-47ff-89b3-3c169c20cbad None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.111889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 787/1570] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:55:22.113179 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6489d9e-8676-48f8-b9ea-0b0ad1a59411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.113394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15fdea-a715-45af-aa06-5c10ceb4de1c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.114368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6489d9e-8676-48f8-b9ea-0b0ad1a59411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.114654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6489d9e-8676-48f8-b9ea-0b0ad1a59411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.114932 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6489d9e-8676-48f8-b9ea-0b0ad1a59411 admin admin] PATH_INFO: `/v3/projects/e02037a2b8e6466b9c864110fb43910a/users/84263576aaec455a91b6035cc5dca4ff/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.122825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15fdea-a715-45af-aa06-5c10ceb4de1c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.127414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7caf53-cb0e-44d2-8b8f-30227e319205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.128069 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7caf53-cb0e-44d2-8b8f-30227e319205 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.128641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7caf53-cb0e-44d2-8b8f-30227e319205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.129158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7caf53-cb0e-44d2-8b8f-30227e319205 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.130099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7caf53-cb0e-44d2-8b8f-30227e319205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:22.130414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7caf53-cb0e-44d2-8b8f-30227e319205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.130979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6489d9e-8676-48f8-b9ea-0b0ad1a59411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02037a2b8e6466b9c864110fb43910a, user_id=84263576aaec455a91b6035cc5dca4ff, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.132005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7caf53-cb0e-44d2-8b8f-30227e319205 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.132108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: WARNING py.warnings [None req-d6489d9e-8676-48f8-b9ea-0b0ad1a59411 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:55:22.132108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: warnings.warn(msg) Jun 16 14:55:22.132108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: Jun 16 14:55:22.133973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6489d9e-8676-48f8-b9ea-0b0ad1a59411 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.136238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:22.146162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 788/1571] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:55:22.147111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7caf53-cb0e-44d2-8b8f-30227e319205 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.150288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 784/1572] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:22 2022] PUT /identity/v3/projects/e02037a2b8e6466b9c864110fb43910a/users/84263576aaec455a91b6035cc5dca4ff/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:22.150900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6489d9e-8676-48f8-b9ea-0b0ad1a59411 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.157060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7caf53-cb0e-44d2-8b8f-30227e319205 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.214515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f01d91-10aa-489b-9546-5a82c7b9c378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.214955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f01d91-10aa-489b-9546-5a82c7b9c378 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.215236 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f01d91-10aa-489b-9546-5a82c7b9c378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.215517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f01d91-10aa-489b-9546-5a82c7b9c378 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.216239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f01d91-10aa-489b-9546-5a82c7b9c378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:22.216542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f01d91-10aa-489b-9546-5a82c7b9c378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.219410 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f01d91-10aa-489b-9546-5a82c7b9c378 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.226608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6489d9e-8676-48f8-b9ea-0b0ad1a59411 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.231353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2549c-ac4e-46e7-a5ad-38c44f4525ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.232040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2549c-ac4e-46e7-a5ad-38c44f4525ed admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.232325 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2549c-ac4e-46e7-a5ad-38c44f4525ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.232609 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2549c-ac4e-46e7-a5ad-38c44f4525ed admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.233304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2549c-ac4e-46e7-a5ad-38c44f4525ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.235281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2549c-ac4e-46e7-a5ad-38c44f4525ed admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.236178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 789/1573] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:55:22.237081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f01d91-10aa-489b-9546-5a82c7b9c378 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.250325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f01d91-10aa-489b-9546-5a82c7b9c378 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.256300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79347e3d-0b36-43da-a72a-64bc73a32ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.256801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 785/1574] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.257061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79347e3d-0b36-43da-a72a-64bc73a32ede admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.257345 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79347e3d-0b36-43da-a72a-64bc73a32ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.257632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79347e3d-0b36-43da-a72a-64bc73a32ede admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.257747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2549c-ac4e-46e7-a5ad-38c44f4525ed admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.258400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79347e3d-0b36-43da-a72a-64bc73a32ede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:22.258714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79347e3d-0b36-43da-a72a-64bc73a32ede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.260347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79347e3d-0b36-43da-a72a-64bc73a32ede admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.267404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2549c-ac4e-46e7-a5ad-38c44f4525ed admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.273848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9c2ef-8a17-45ea-b88c-762a2fe9599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.274513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 790/1575] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:55:22.274613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9c2ef-8a17-45ea-b88c-762a2fe9599c admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.274701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79347e3d-0b36-43da-a72a-64bc73a32ede admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.274778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9c2ef-8a17-45ea-b88c-762a2fe9599c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.274898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9c2ef-8a17-45ea-b88c-762a2fe9599c admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.275590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9c2ef-8a17-45ea-b88c-762a2fe9599c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.276640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: WARNING py.warnings [None req-f7f9c2ef-8a17-45ea-b88c-762a2fe9599c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:55:22.276640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: warnings.warn(msg) Jun 16 14:55:22.276640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: Jun 16 14:55:22.277813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9c2ef-8a17-45ea-b88c-762a2fe9599c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.290975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79347e3d-0b36-43da-a72a-64bc73a32ede admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.295804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62749e0-3298-4a7f-aeed-d979e63467dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.296414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62749e0-3298-4a7f-aeed-d979e63467dd admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.296700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62749e0-3298-4a7f-aeed-d979e63467dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.296968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62749e0-3298-4a7f-aeed-d979e63467dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.297686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62749e0-3298-4a7f-aeed-d979e63467dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:22.298019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62749e0-3298-4a7f-aeed-d979e63467dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.299589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62749e0-3298-4a7f-aeed-d979e63467dd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.308029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 786/1576] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.308029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9c2ef-8a17-45ea-b88c-762a2fe9599c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.315128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 791/1577] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:55:22.316641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191da0d-133b-4be3-b925-4b351a6b0991 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.317021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191da0d-133b-4be3-b925-4b351a6b0991 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.317310 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191da0d-133b-4be3-b925-4b351a6b0991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.338536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2191da0d-133b-4be3-b925-4b351a6b0991 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:22.339735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2191da0d-133b-4be3-b925-4b351a6b0991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:22.374641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9c2ef-8a17-45ea-b88c-762a2fe9599c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.380084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6002d2e-c799-4169-b02a-d523b86bf4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.380750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6002d2e-c799-4169-b02a-d523b86bf4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.381037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6002d2e-c799-4169-b02a-d523b86bf4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.381316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6002d2e-c799-4169-b02a-d523b86bf4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.382040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6002d2e-c799-4169-b02a-d523b86bf4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.384037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6002d2e-c799-4169-b02a-d523b86bf4b1 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.401921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 792/1578] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:22.403054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191da0d-133b-4be3-b925-4b351a6b0991 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.412985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 787/1579] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.413408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191da0d-133b-4be3-b925-4b351a6b0991 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.414219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6002d2e-c799-4169-b02a-d523b86bf4b1 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.433255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:22.464095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:22.473341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885c06e-1a0d-4aa4-8c8e-07f82ff0f11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.473731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c06e-1a0d-4aa4-8c8e-07f82ff0f11c admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.474054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c06e-1a0d-4aa4-8c8e-07f82ff0f11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.474332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c06e-1a0d-4aa4-8c8e-07f82ff0f11c admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.475086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885c06e-1a0d-4aa4-8c8e-07f82ff0f11c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.476986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885c06e-1a0d-4aa4-8c8e-07f82ff0f11c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.479676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6002d2e-c799-4169-b02a-d523b86bf4b1 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.484221 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f41bb-9ee1-4523-8a62-cb0a7a8fdcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.484909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f41bb-9ee1-4523-8a62-cb0a7a8fdcb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.485214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f41bb-9ee1-4523-8a62-cb0a7a8fdcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.485494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f41bb-9ee1-4523-8a62-cb0a7a8fdcb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.486225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f41bb-9ee1-4523-8a62-cb0a7a8fdcb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.488584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f41bb-9ee1-4523-8a62-cb0a7a8fdcb4 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.502658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 793/1580] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/projects => generated 355 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.504109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885c06e-1a0d-4aa4-8c8e-07f82ff0f11c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.522088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 788/1581] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.522873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f41bb-9ee1-4523-8a62-cb0a7a8fdcb4 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.568630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885c06e-1a0d-4aa4-8c8e-07f82ff0f11c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.585991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f41bb-9ee1-4523-8a62-cb0a7a8fdcb4 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.590704 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17182ea-cf7e-4988-b405-5f5f3d6f9fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.591372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17182ea-cf7e-4988-b405-5f5f3d6f9fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.591654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17182ea-cf7e-4988-b405-5f5f3d6f9fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.591933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17182ea-cf7e-4988-b405-5f5f3d6f9fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.592626 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17182ea-cf7e-4988-b405-5f5f3d6f9fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.594573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17182ea-cf7e-4988-b405-5f5f3d6f9fb6 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.620266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 789/1582] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.621085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17182ea-cf7e-4988-b405-5f5f3d6f9fb6 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.626781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ede69-a4e3-4895-91bc-1ea6dedaf443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.627453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ede69-a4e3-4895-91bc-1ea6dedaf443 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.627757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ede69-a4e3-4895-91bc-1ea6dedaf443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.628030 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ede69-a4e3-4895-91bc-1ea6dedaf443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.629452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ede69-a4e3-4895-91bc-1ea6dedaf443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.631067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ede69-a4e3-4895-91bc-1ea6dedaf443 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.642004 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 794/1583] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:22.642875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ede69-a4e3-4895-91bc-1ea6dedaf443 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.652588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ede69-a4e3-4895-91bc-1ea6dedaf443 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.686433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17182ea-cf7e-4988-b405-5f5f3d6f9fb6 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.692051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fbac6-7e34-4745-8382-8b328c5c5293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.692720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fbac6-7e34-4745-8382-8b328c5c5293 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.693006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fbac6-7e34-4745-8382-8b328c5c5293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.693284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fbac6-7e34-4745-8382-8b328c5c5293 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.694012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fbac6-7e34-4745-8382-8b328c5c5293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.695954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fbac6-7e34-4745-8382-8b328c5c5293 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.707561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:22.717862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 790/1584] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.718794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fbac6-7e34-4745-8382-8b328c5c5293 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.719476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c799-ff7b-453e-81df-569824fc93ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.720148 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c799-ff7b-453e-81df-569824fc93ea admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.720448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c799-ff7b-453e-81df-569824fc93ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.720714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c799-ff7b-453e-81df-569824fc93ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.721656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765c799-ff7b-453e-81df-569824fc93ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.723689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765c799-ff7b-453e-81df-569824fc93ea admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.750254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 795/1585] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.751078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c799-ff7b-453e-81df-569824fc93ea admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.774420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:22.780307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fbac6-7e34-4745-8382-8b328c5c5293 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.815954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c799-ff7b-453e-81df-569824fc93ea admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.820568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fd3de-de8f-4f1e-b6ff-f250420d725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.821181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fd3de-de8f-4f1e-b6ff-f250420d725c admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.821462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fd3de-de8f-4f1e-b6ff-f250420d725c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.821737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fd3de-de8f-4f1e-b6ff-f250420d725c admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.822602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fd3de-de8f-4f1e-b6ff-f250420d725c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.824519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fd3de-de8f-4f1e-b6ff-f250420d725c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.832250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d38bca-f834-4226-ba2d-77cc6c65bfd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.832904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d38bca-f834-4226-ba2d-77cc6c65bfd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.833183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d38bca-f834-4226-ba2d-77cc6c65bfd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.833458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d38bca-f834-4226-ba2d-77cc6c65bfd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.846800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 796/1586] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.848006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d38bca-f834-4226-ba2d-77cc6c65bfd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.848140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fd3de-de8f-4f1e-b6ff-f250420d725c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.849479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d38bca-f834-4226-ba2d-77cc6c65bfd0 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.858763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fd3de-de8f-4f1e-b6ff-f250420d725c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.859921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 791/1587] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:22.860713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d38bca-f834-4226-ba2d-77cc6c65bfd0 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.864149 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6080d-9700-43e3-97b7-e9dd3140e85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.864819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6080d-9700-43e3-97b7-e9dd3140e85a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.865380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6080d-9700-43e3-97b7-e9dd3140e85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.865661 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6080d-9700-43e3-97b7-e9dd3140e85a admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.866387 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6080d-9700-43e3-97b7-e9dd3140e85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.868289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6080d-9700-43e3-97b7-e9dd3140e85a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.870091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d38bca-f834-4226-ba2d-77cc6c65bfd0 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.875535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb112-960f-4777-992d-d4b8950cd12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.876645 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb112-960f-4777-992d-d4b8950cd12d admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.877752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb112-960f-4777-992d-d4b8950cd12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.877752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb112-960f-4777-992d-d4b8950cd12d admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.879398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183eb112-960f-4777-992d-d4b8950cd12d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.881889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183eb112-960f-4777-992d-d4b8950cd12d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.890138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 797/1588] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/users => generated 278 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.891254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6080d-9700-43e3-97b7-e9dd3140e85a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.903349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6080d-9700-43e3-97b7-e9dd3140e85a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.905124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 792/1589] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.906068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb112-960f-4777-992d-d4b8950cd12d admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.912095 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50370cd1-5fd7-4c38-90c0-445bc728200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.912754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50370cd1-5fd7-4c38-90c0-445bc728200c admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.913033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50370cd1-5fd7-4c38-90c0-445bc728200c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.913304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50370cd1-5fd7-4c38-90c0-445bc728200c admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.914044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50370cd1-5fd7-4c38-90c0-445bc728200c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.915938 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50370cd1-5fd7-4c38-90c0-445bc728200c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.919238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb112-960f-4777-992d-d4b8950cd12d admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.924061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2a1dd-9e2a-4a63-a067-dfd2cfb98e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.924746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2a1dd-9e2a-4a63-a067-dfd2cfb98e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.925047 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2a1dd-9e2a-4a63-a067-dfd2cfb98e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.925334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2a1dd-9e2a-4a63-a067-dfd2cfb98e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.926179 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2a1dd-9e2a-4a63-a067-dfd2cfb98e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.927805 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2a1dd-9e2a-4a63-a067-dfd2cfb98e0e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.940694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 798/1590] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:22.941482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 793/1591] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:22.941745 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50370cd1-5fd7-4c38-90c0-445bc728200c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.942400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2a1dd-9e2a-4a63-a067-dfd2cfb98e0e admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.954181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50370cd1-5fd7-4c38-90c0-445bc728200c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.959052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2a1dd-9e2a-4a63-a067-dfd2cfb98e0e admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.960017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486112b-a2a7-48d5-958a-15c3d9425c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.960746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486112b-a2a7-48d5-958a-15c3d9425c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.961031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486112b-a2a7-48d5-958a-15c3d9425c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.961308 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486112b-a2a7-48d5-958a-15c3d9425c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.962078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486112b-a2a7-48d5-958a-15c3d9425c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.964090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486112b-a2a7-48d5-958a-15c3d9425c16 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.965201 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135457d-131e-4fcf-8451-4e06265bcfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.966339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135457d-131e-4fcf-8451-4e06265bcfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.966492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135457d-131e-4fcf-8451-4e06265bcfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.966668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135457d-131e-4fcf-8451-4e06265bcfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.967363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135457d-131e-4fcf-8451-4e06265bcfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:22.969672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135457d-131e-4fcf-8451-4e06265bcfb3 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:22.977186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 799/1592] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:22.980491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486112b-a2a7-48d5-958a-15c3d9425c16 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:22.989534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486112b-a2a7-48d5-958a-15c3d9425c16 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:22.996510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f6b93-fe11-4a39-882f-db833c96f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:22.997192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6b93-fe11-4a39-882f-db833c96f7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:22.997477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6b93-fe11-4a39-882f-db833c96f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:22.997754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6b93-fe11-4a39-882f-db833c96f7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:22.998551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f6b93-fe11-4a39-882f-db833c96f7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.000132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f6b93-fe11-4a39-882f-db833c96f7a9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.007054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 794/1593] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:22 2022] POST /identity/v3/users => generated 294 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:23.008185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135457d-131e-4fcf-8451-4e06265bcfb3 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.016332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 800/1594] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:23.017256 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f6b93-fe11-4a39-882f-db833c96f7a9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.022543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135457d-131e-4fcf-8451-4e06265bcfb3 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.027931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fed5ce-76fa-410c-9472-1dea4903b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.029060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed5ce-76fa-410c-9472-1dea4903b2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.029202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f6b93-fe11-4a39-882f-db833c96f7a9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.029314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed5ce-76fa-410c-9472-1dea4903b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.029314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed5ce-76fa-410c-9472-1dea4903b2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.030313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fed5ce-76fa-410c-9472-1dea4903b2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.032016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fed5ce-76fa-410c-9472-1dea4903b2d0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.034195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca88670-b83b-4c41-98d1-e63d7541632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.035660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88670-b83b-4c41-98d1-e63d7541632d admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.035983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88670-b83b-4c41-98d1-e63d7541632d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.036267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88670-b83b-4c41-98d1-e63d7541632d admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.037008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca88670-b83b-4c41-98d1-e63d7541632d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.038771 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca88670-b83b-4c41-98d1-e63d7541632d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.047787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 795/1595] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:23.048648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fed5ce-76fa-410c-9472-1dea4903b2d0 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.054845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 801/1596] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:23.055747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca88670-b83b-4c41-98d1-e63d7541632d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.063245 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fed5ce-76fa-410c-9472-1dea4903b2d0 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.067895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca88670-b83b-4c41-98d1-e63d7541632d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.069370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204cdb6-39df-4475-b12a-f4ce992e9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.070183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204cdb6-39df-4475-b12a-f4ce992e9f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.070684 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204cdb6-39df-4475-b12a-f4ce992e9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.070937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204cdb6-39df-4475-b12a-f4ce992e9f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.071755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204cdb6-39df-4475-b12a-f4ce992e9f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.072785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c8460-a122-4ce1-8075-eb4ca92c1f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.073491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204cdb6-39df-4475-b12a-f4ce992e9f92 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.073776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c8460-a122-4ce1-8075-eb4ca92c1f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.074112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c8460-a122-4ce1-8075-eb4ca92c1f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.074385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c8460-a122-4ce1-8075-eb4ca92c1f7f admin admin] PATH_INFO: `/v3/projects/0eec2973f1b24982bf56c38e77d91481/users/555dc188a72647f3af56b774d04ab4b0/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.085180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 796/1597] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:23.086436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204cdb6-39df-4475-b12a-f4ce992e9f92 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.094970 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c8460-a122-4ce1-8075-eb4ca92c1f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eec2973f1b24982bf56c38e77d91481, user_id=555dc188a72647f3af56b774d04ab4b0, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.098909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c8460-a122-4ce1-8075-eb4ca92c1f7f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.099069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204cdb6-39df-4475-b12a-f4ce992e9f92 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.104620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bb4aa-df7d-43c8-8941-90ca6b3502f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.105315 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bb4aa-df7d-43c8-8941-90ca6b3502f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.105618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bb4aa-df7d-43c8-8941-90ca6b3502f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.105860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bb4aa-df7d-43c8-8941-90ca6b3502f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.106589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bb4aa-df7d-43c8-8941-90ca6b3502f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.108387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bb4aa-df7d-43c8-8941-90ca6b3502f7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.120449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 802/1598] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:23 2022] PUT /identity/v3/projects/0eec2973f1b24982bf56c38e77d91481/users/555dc188a72647f3af56b774d04ab4b0/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:23.121420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c8460-a122-4ce1-8075-eb4ca92c1f7f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.137964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 797/1599] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:23.140179 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bb4aa-df7d-43c8-8941-90ca6b3502f7 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.153993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bb4aa-df7d-43c8-8941-90ca6b3502f7 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.174800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:23.205473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c8460-a122-4ce1-8075-eb4ca92c1f7f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.210835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4bf2c-a07f-4dcf-8ee0-94dd17b34019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.211767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4bf2c-a07f-4dcf-8ee0-94dd17b34019 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.211892 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4bf2c-a07f-4dcf-8ee0-94dd17b34019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.212237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4bf2c-a07f-4dcf-8ee0-94dd17b34019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.213166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4bf2c-a07f-4dcf-8ee0-94dd17b34019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.214942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4bf2c-a07f-4dcf-8ee0-94dd17b34019 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.217629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92553a2b-ee80-47f0-9611-1e7ca6beb1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.218351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553a2b-ee80-47f0-9611-1e7ca6beb1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.218638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553a2b-ee80-47f0-9611-1e7ca6beb1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.218917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553a2b-ee80-47f0-9611-1e7ca6beb1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.219882 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92553a2b-ee80-47f0-9611-1e7ca6beb1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.221668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92553a2b-ee80-47f0-9611-1e7ca6beb1c9 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.227128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 803/1600] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:23.228386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4bf2c-a07f-4dcf-8ee0-94dd17b34019 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.237507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 798/1601] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:23.237507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92553a2b-ee80-47f0-9611-1e7ca6beb1c9 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.246765 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4bf2c-a07f-4dcf-8ee0-94dd17b34019 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.250330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92553a2b-ee80-47f0-9611-1e7ca6beb1c9 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.252906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248082d9-f80c-4d9c-982f-ddfc143d7030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.254030 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248082d9-f80c-4d9c-982f-ddfc143d7030 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.254505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248082d9-f80c-4d9c-982f-ddfc143d7030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.254933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248082d9-f80c-4d9c-982f-ddfc143d7030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.255935 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248082d9-f80c-4d9c-982f-ddfc143d7030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.256340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c83a-464e-4557-9904-65f44b5459c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.257928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248082d9-f80c-4d9c-982f-ddfc143d7030 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.258105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c83a-464e-4557-9904-65f44b5459c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.258511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c83a-464e-4557-9904-65f44b5459c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.258889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c83a-464e-4557-9904-65f44b5459c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.259721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c83a-464e-4557-9904-65f44b5459c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.261432 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c83a-464e-4557-9904-65f44b5459c7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.271880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 804/1602] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:23.273113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248082d9-f80c-4d9c-982f-ddfc143d7030 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.282365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 799/1603] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:23.282365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61a0cd-a468-4a59-95c4-483d7fcfd857 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.282365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61a0cd-a468-4a59-95c4-483d7fcfd857 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.282365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61a0cd-a468-4a59-95c4-483d7fcfd857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.289199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248082d9-f80c-4d9c-982f-ddfc143d7030 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.295672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9708429-bca8-4f1b-89fd-aa363667d00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.296615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708429-bca8-4f1b-89fd-aa363667d00f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.297079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708429-bca8-4f1b-89fd-aa363667d00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.297518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708429-bca8-4f1b-89fd-aa363667d00f admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.298451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9708429-bca8-4f1b-89fd-aa363667d00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.300990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9708429-bca8-4f1b-89fd-aa363667d00f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.304938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-dd61a0cd-a468-4a59-95c4-483d7fcfd857 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:23.306351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-dd61a0cd-a468-4a59-95c4-483d7fcfd857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:23.314338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 800/1604] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:23.316215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 805/1605] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:23.317497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9708429-bca8-4f1b-89fd-aa363667d00f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.320082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61a0cd-a468-4a59-95c4-483d7fcfd857 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.327282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:23.333368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61a0cd-a468-4a59-95c4-483d7fcfd857 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.336968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9708429-bca8-4f1b-89fd-aa363667d00f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.341993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc97a5e-8ef4-4cdc-92f5-e702ee8a28b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.342675 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc97a5e-8ef4-4cdc-92f5-e702ee8a28b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.342960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc97a5e-8ef4-4cdc-92f5-e702ee8a28b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.343236 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc97a5e-8ef4-4cdc-92f5-e702ee8a28b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.343964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc97a5e-8ef4-4cdc-92f5-e702ee8a28b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.344080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954284b7-1751-4469-b148-b21956557f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.345793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc97a5e-8ef4-4cdc-92f5-e702ee8a28b3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.346245 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954284b7-1751-4469-b148-b21956557f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.347368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954284b7-1751-4469-b148-b21956557f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.348205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954284b7-1751-4469-b148-b21956557f7a admin admin] PATH_INFO: `/v3/projects/f81d00af3114481bba69aef5d4e23223/users/dee8a9eb135a4e53bf88747bb24c4bc2/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.357452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 806/1606] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:23.358303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc97a5e-8ef4-4cdc-92f5-e702ee8a28b3 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.368078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954284b7-1751-4469-b148-b21956557f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81d00af3114481bba69aef5d4e23223, user_id=dee8a9eb135a4e53bf88747bb24c4bc2, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.368996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc97a5e-8ef4-4cdc-92f5-e702ee8a28b3 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.370982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954284b7-1751-4469-b148-b21956557f7a admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.373747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c122f6d-8930-44d7-ba06-1d70f5cd32f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.374681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c122f6d-8930-44d7-ba06-1d70f5cd32f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.374956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c122f6d-8930-44d7-ba06-1d70f5cd32f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.375340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c122f6d-8930-44d7-ba06-1d70f5cd32f0 admin admin] PATH_INFO: `/v3/projects/08a6102809be485688231879c583e2b9/users/7efff0603fb7461ca799c67a8050e181/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.390729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 801/1607] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:23 2022] PUT /identity/v3/projects/f81d00af3114481bba69aef5d4e23223/users/dee8a9eb135a4e53bf88747bb24c4bc2/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:23.391642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954284b7-1751-4469-b148-b21956557f7a admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.399440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c122f6d-8930-44d7-ba06-1d70f5cd32f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a6102809be485688231879c583e2b9, user_id=7efff0603fb7461ca799c67a8050e181, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.402641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c122f6d-8930-44d7-ba06-1d70f5cd32f0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.420581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 807/1608] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:23 2022] PUT /identity/v3/projects/08a6102809be485688231879c583e2b9/users/7efff0603fb7461ca799c67a8050e181/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:23.422045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c122f6d-8930-44d7-ba06-1d70f5cd32f0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.464048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954284b7-1751-4469-b148-b21956557f7a admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.491451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c122f6d-8930-44d7-ba06-1d70f5cd32f0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.496440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518630-c8cf-4ef1-ad0c-e9054b283643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.497340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518630-c8cf-4ef1-ad0c-e9054b283643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.497626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518630-c8cf-4ef1-ad0c-e9054b283643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.497944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518630-c8cf-4ef1-ad0c-e9054b283643 admin admin] PATH_INFO: `/v3/projects/eb37393acca7490094455e179543e524/users/561c947ee70e4521b594f0d528e6e6dd/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.517801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31518630-c8cf-4ef1-ad0c-e9054b283643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb37393acca7490094455e179543e524, user_id=561c947ee70e4521b594f0d528e6e6dd, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.521068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31518630-c8cf-4ef1-ad0c-e9054b283643 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.527702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23824d69-38ab-440b-a973-d7e23a556ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.529044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824d69-38ab-440b-a973-d7e23a556ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.529651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824d69-38ab-440b-a973-d7e23a556ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.530071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824d69-38ab-440b-a973-d7e23a556ac3 admin admin] PATH_INFO: `/v3/projects/2631270cfaed4db581252080173bf6fa/users/411b174063b24c1fbc67fc7fab980e45/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.536608 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 808/1609] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:23 2022] PUT /identity/v3/projects/eb37393acca7490094455e179543e524/users/561c947ee70e4521b594f0d528e6e6dd/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:23.537599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518630-c8cf-4ef1-ad0c-e9054b283643 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.551613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23824d69-38ab-440b-a973-d7e23a556ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2631270cfaed4db581252080173bf6fa, user_id=411b174063b24c1fbc67fc7fab980e45, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.554518 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23824d69-38ab-440b-a973-d7e23a556ac3 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.570941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 802/1610] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:23 2022] PUT /identity/v3/projects/2631270cfaed4db581252080173bf6fa/users/411b174063b24c1fbc67fc7fab980e45/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:23.578900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23824d69-38ab-440b-a973-d7e23a556ac3 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.615837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:23.621080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518630-c8cf-4ef1-ad0c-e9054b283643 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.657334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23824d69-38ab-440b-a973-d7e23a556ac3 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.661519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7b6af-fc12-4b4f-9b3a-c039d24dbd61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.662349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7b6af-fc12-4b4f-9b3a-c039d24dbd61 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.662637 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7b6af-fc12-4b4f-9b3a-c039d24dbd61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.662912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7b6af-fc12-4b4f-9b3a-c039d24dbd61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.698065 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:23.725659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067759e-dfba-4f43-a3f4-51918746b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.727747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067759e-dfba-4f43-a3f4-51918746b898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.729071 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067759e-dfba-4f43-a3f4-51918746b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.729297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067759e-dfba-4f43-a3f4-51918746b898 admin admin] PATH_INFO: `/v3/projects/a3994949ab10416c93c40a2de93cac04/users/370720ef354f4ae79383c6e34208d273/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.746715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067759e-dfba-4f43-a3f4-51918746b898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3994949ab10416c93c40a2de93cac04, user_id=370720ef354f4ae79383c6e34208d273, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.749390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067759e-dfba-4f43-a3f4-51918746b898 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.751480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7b6af-fc12-4b4f-9b3a-c039d24dbd61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.752922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7b6af-fc12-4b4f-9b3a-c039d24dbd61 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.776513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 803/1611] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:23.777693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7b6af-fc12-4b4f-9b3a-c039d24dbd61 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.779319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 809/1612] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:23 2022] PUT /identity/v3/projects/a3994949ab10416c93c40a2de93cac04/users/370720ef354f4ae79383c6e34208d273/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:23.781646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f78b1-dc01-461e-ab26-ca3c91b8b628 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.782210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f78b1-dc01-461e-ab26-ca3c91b8b628 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.782687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f78b1-dc01-461e-ab26-ca3c91b8b628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.806727 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7b6af-fc12-4b4f-9b3a-c039d24dbd61 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.818041 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-924f78b1-dc01-461e-ab26-ca3c91b8b628 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:23.819467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-924f78b1-dc01-461e-ab26-ca3c91b8b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:23.898678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f6c33-9e25-4b07-93e6-cfd9542de162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.900501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f6c33-9e25-4b07-93e6-cfd9542de162 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.900821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f6c33-9e25-4b07-93e6-cfd9542de162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.901176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f6c33-9e25-4b07-93e6-cfd9542de162 admin admin] PATH_INFO: `/v3/projects/ea2cd423f876438e88c98b4a2405834a/users/765e8ba07bc1465fa3ce3444d05ad36b/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.930610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f6c33-9e25-4b07-93e6-cfd9542de162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2cd423f876438e88c98b4a2405834a, user_id=765e8ba07bc1465fa3ce3444d05ad36b, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.935736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f6c33-9e25-4b07-93e6-cfd9542de162 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.969405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 810/1613] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:23.969873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b1c5-e099-4898-81a7-79fa9a80e9ac None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.970150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b1c5-e099-4898-81a7-79fa9a80e9ac None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.970429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b1c5-e099-4898-81a7-79fa9a80e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.983892 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 804/1614] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:23 2022] PUT /identity/v3/projects/ea2cd423f876438e88c98b4a2405834a/users/765e8ba07bc1465fa3ce3444d05ad36b/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:23.992593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4013357-9d8f-4bdf-b366-2ca0dd39b03c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.993011 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4013357-9d8f-4bdf-b366-2ca0dd39b03c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.993297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4013357-9d8f-4bdf-b366-2ca0dd39b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:24.034124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4907b1c5-e099-4898-81a7-79fa9a80e9ac None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:24.037023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4907b1c5-e099-4898-81a7-79fa9a80e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:24.045275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-f4013357-9d8f-4bdf-b366-2ca0dd39b03c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:24.049656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f4013357-9d8f-4bdf-b366-2ca0dd39b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:24.175381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 805/1615] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:24.179610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbc590-fdf5-419b-9c9c-ca90591b1d97 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:24.180549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbc590-fdf5-419b-9c9c-ca90591b1d97 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:24.182417 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbc590-fdf5-419b-9c9c-ca90591b1d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:24.186941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 811/1616] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:24.187365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560512-dc41-493b-9172-eca2e3ea02f6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:24.187664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560512-dc41-493b-9172-eca2e3ea02f6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:24.187946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560512-dc41-493b-9172-eca2e3ea02f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:24.249140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-29560512-dc41-493b-9172-eca2e3ea02f6 None None] MFA Rules not processed for user `370720ef354f4ae79383c6e34208d273`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:24.250519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-29560512-dc41-493b-9172-eca2e3ea02f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:24.253216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a3fbc590-fdf5-419b-9c9c-ca90591b1d97 None None] MFA Rules not processed for user `411b174063b24c1fbc67fc7fab980e45`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:24.255491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a3fbc590-fdf5-419b-9c9c-ca90591b1d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:24.285862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:24.318454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:24.382120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 806/1617] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:24 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:24.384716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc731a-91a7-42ca-9a1d-b5aaf21e5547 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:24.385015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc731a-91a7-42ca-9a1d-b5aaf21e5547 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:24.385298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc731a-91a7-42ca-9a1d-b5aaf21e5547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:24.402304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 812/1618] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:24.403231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29560512-dc41-493b-9172-eca2e3ea02f6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:24.411920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6abc731a-91a7-42ca-9a1d-b5aaf21e5547 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:24.414754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6abc731a-91a7-42ca-9a1d-b5aaf21e5547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:24.429442 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 807/1619] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:24.431057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc731a-91a7-42ca-9a1d-b5aaf21e5547 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:24.532964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc731a-91a7-42ca-9a1d-b5aaf21e5547 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:24.536803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29560512-dc41-493b-9172-eca2e3ea02f6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:24.539159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0c128-842a-4e3e-8635-cdbcec071b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:24.540298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0c128-842a-4e3e-8635-cdbcec071b4b service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:24.540788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0c128-842a-4e3e-8635-cdbcec071b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:24.541272 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0c128-842a-4e3e-8635-cdbcec071b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:24.543731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9577e-43ca-4758-b9dc-9591c6ec88c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:24.544955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9577e-43ca-4758-b9dc-9591c6ec88c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:24.545656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9577e-43ca-4758-b9dc-9591c6ec88c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:24.546165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9577e-43ca-4758-b9dc-9591c6ec88c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:24.553275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0c128-842a-4e3e-8635-cdbcec071b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:24.554981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0c128-842a-4e3e-8635-cdbcec071b4b service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:24.564544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9577e-43ca-4758-b9dc-9591c6ec88c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:24.566956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9577e-43ca-4758-b9dc-9591c6ec88c5 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:24.567177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 808/1620] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:24.568221 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0c128-842a-4e3e-8635-cdbcec071b4b service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:24.577593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0c128-842a-4e3e-8635-cdbcec071b4b service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:24.586148 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151eb91-2bc9-4128-809c-6d0326160f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:24.587054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151eb91-2bc9-4128-809c-6d0326160f2b service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:24.587446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151eb91-2bc9-4128-809c-6d0326160f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:24.587787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151eb91-2bc9-4128-809c-6d0326160f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:24.589240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 813/1621] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:24.590205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9577e-43ca-4758-b9dc-9591c6ec88c5 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:24.606909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9577e-43ca-4758-b9dc-9591c6ec88c5 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:24.615055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2e976-952d-486b-bcb7-fab2fd71e6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:24.616054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e976-952d-486b-bcb7-fab2fd71e6ad admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:24.616599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e976-952d-486b-bcb7-fab2fd71e6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:24.617597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e976-952d-486b-bcb7-fab2fd71e6ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:24.618597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2e976-952d-486b-bcb7-fab2fd71e6ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:24.620194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151eb91-2bc9-4128-809c-6d0326160f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:24.621789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2e976-952d-486b-bcb7-fab2fd71e6ad admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:24.622646 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151eb91-2bc9-4128-809c-6d0326160f2b service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:24.642289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 809/1622] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:24.650656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808db8ce-36a5-468f-93aa-f3d5786a9f4c None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:24.651180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808db8ce-36a5-468f-93aa-f3d5786a9f4c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:24.663323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808db8ce-36a5-468f-93aa-f3d5786a9f4c None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:24.667654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 810/1623] 10.222.0.81 () {54 vars in 961 bytes} [Thu Jun 16 14:55:24 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:24.676039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808db8ce-36a5-468f-93aa-f3d5786a9f4c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:24.690109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 814/1624] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:24 2022] POST /identity/v3/projects => generated 353 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:24.692933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5275-1d75-452b-8539-b3446dbd1f67 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:24.693241 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5275-1d75-452b-8539-b3446dbd1f67 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:24.693737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5275-1d75-452b-8539-b3446dbd1f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:24.701096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808db8ce-36a5-468f-93aa-f3d5786a9f4c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:24.737158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-791c5275-1d75-452b-8539-b3446dbd1f67 None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:24.741527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-791c5275-1d75-452b-8539-b3446dbd1f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:24.832551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fe876-1f50-4bbd-ae8a-e9c0d0568d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:24.834814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe876-1f50-4bbd-ae8a-e9c0d0568d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:24.835734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe876-1f50-4bbd-ae8a-e9c0d0568d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:24.836932 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe876-1f50-4bbd-ae8a-e9c0d0568d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:24.949941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 815/1625] 10.222.0.81 () {58 vars in 1058 bytes} [Thu Jun 16 14:55:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:24.950916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c5275-1d75-452b-8539-b3446dbd1f67 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:25.032361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fe876-1f50-4bbd-ae8a-e9c0d0568d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:25.038738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fe876-1f50-4bbd-ae8a-e9c0d0568d07 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:25.043990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:25.058888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 811/1626] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:25.060021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fe876-1f50-4bbd-ae8a-e9c0d0568d07 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:25.077116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fe876-1f50-4bbd-ae8a-e9c0d0568d07 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:25.085921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117cb61-6c94-4634-af92-5d4393b193a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:25.086577 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117cb61-6c94-4634-af92-5d4393b193a8 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:25.086856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117cb61-6c94-4634-af92-5d4393b193a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:25.087131 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117cb61-6c94-4634-af92-5d4393b193a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:25.093072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:25.139077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c5275-1d75-452b-8539-b3446dbd1f67 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:25.155706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713af53-61d4-4e56-9cf5-e6ce8bb4ad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:25.156589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713af53-61d4-4e56-9cf5-e6ce8bb4ad8a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:25.156886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713af53-61d4-4e56-9cf5-e6ce8bb4ad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:25.157684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713af53-61d4-4e56-9cf5-e6ce8bb4ad8a admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:25.158430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713af53-61d4-4e56-9cf5-e6ce8bb4ad8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:25.160524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713af53-61d4-4e56-9cf5-e6ce8bb4ad8a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:25.177827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117cb61-6c94-4634-af92-5d4393b193a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:25.179830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117cb61-6c94-4634-af92-5d4393b193a8 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:25.196249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 812/1627] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:25.206417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 816/1628] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:24 2022] POST /identity/v3/users => generated 283 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:25.210556 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117cb61-6c94-4634-af92-5d4393b193a8 service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:25.243761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117cb61-6c94-4634-af92-5d4393b193a8 service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:25.258326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c53b6-ea79-46bf-9c45-06645a8f0cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:25.260822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c53b6-ea79-46bf-9c45-06645a8f0cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:25.261110 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c53b6-ea79-46bf-9c45-06645a8f0cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:25.261388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c53b6-ea79-46bf-9c45-06645a8f0cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:25.264362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c53b6-ea79-46bf-9c45-06645a8f0cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:25.268528 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c53b6-ea79-46bf-9c45-06645a8f0cc3 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:25.293349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 813/1629] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:25.294547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713af53-61d4-4e56-9cf5-e6ce8bb4ad8a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:25.312155 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713af53-61d4-4e56-9cf5-e6ce8bb4ad8a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:25.323361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620720a-8ee8-49bb-abb7-42eccbec183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:25.324697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620720a-8ee8-49bb-abb7-42eccbec183f admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:25.324990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620720a-8ee8-49bb-abb7-42eccbec183f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:25.325269 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620720a-8ee8-49bb-abb7-42eccbec183f admin admin] PATH_INFO: `/v3/projects/2f5d40c6ec7243f281513884bceef7dd/users/45253411713c4ea0aca0462c52d3e6a5/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:25.358657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620720a-8ee8-49bb-abb7-42eccbec183f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5d40c6ec7243f281513884bceef7dd, user_id=45253411713c4ea0aca0462c52d3e6a5, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:25.363874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620720a-8ee8-49bb-abb7-42eccbec183f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:25.390143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 817/1630] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:25 2022] PUT /identity/v3/projects/2f5d40c6ec7243f281513884bceef7dd/users/45253411713c4ea0aca0462c52d3e6a5/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:25.394391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c53b6-ea79-46bf-9c45-06645a8f0cc3 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:25.408971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c53b6-ea79-46bf-9c45-06645a8f0cc3 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:25.526453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07718984-7a34-4153-ae86-80cd2aeaac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:25.527145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718984-7a34-4153-ae86-80cd2aeaac09 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:25.527429 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718984-7a34-4153-ae86-80cd2aeaac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:25.527706 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718984-7a34-4153-ae86-80cd2aeaac09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:25.528439 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07718984-7a34-4153-ae86-80cd2aeaac09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:25.530223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07718984-7a34-4153-ae86-80cd2aeaac09 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:25.545031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 814/1631] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:25.548953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620720a-8ee8-49bb-abb7-42eccbec183f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:25.648101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620720a-8ee8-49bb-abb7-42eccbec183f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:25.648101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b3e19-935d-4934-a1ce-f103762a8488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:25.648101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b3e19-935d-4934-a1ce-f103762a8488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:25.648101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b3e19-935d-4934-a1ce-f103762a8488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:25.649268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b3e19-935d-4934-a1ce-f103762a8488 admin admin] PATH_INFO: `/v3/projects/2f5d40c6ec7243f281513884bceef7dd/users/45253411713c4ea0aca0462c52d3e6a5/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:25.649488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dfed3-2e22-4528-ac34-3d89234788d7 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:25.649488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dfed3-2e22-4528-ac34-3d89234788d7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:25.649488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dfed3-2e22-4528-ac34-3d89234788d7 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:25.649722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b3e19-935d-4934-a1ce-f103762a8488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5d40c6ec7243f281513884bceef7dd, user_id=45253411713c4ea0aca0462c52d3e6a5, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:25.649722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b3e19-935d-4934-a1ce-f103762a8488 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:25.649877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 815/1632] 10.222.0.81 () {54 vars in 912 bytes} [Thu Jun 16 14:55:25 2022] GET /identity => generated 270 bytes in 38 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:25.649877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfe69a-7036-4574-b230-7b1e4c8ac1e6 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:25.649877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfe69a-7036-4574-b230-7b1e4c8ac1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:25.649877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfe69a-7036-4574-b230-7b1e4c8ac1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:25.650190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 818/1633] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:25 2022] PUT /identity/v3/projects/2f5d40c6ec7243f281513884bceef7dd/users/45253411713c4ea0aca0462c52d3e6a5/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:55:25.650190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b3c11-d331-4f7b-9e60-641a047223d4 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:25.650190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b3c11-d331-4f7b-9e60-641a047223d4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:25.650190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b3c11-d331-4f7b-9e60-641a047223d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:25.673538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-61bfe69a-7036-4574-b230-7b1e4c8ac1e6 None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:25.678998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-61bfe69a-7036-4574-b230-7b1e4c8ac1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:25.711198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-db7b3c11-d331-4f7b-9e60-641a047223d4 None None] MFA Rules not processed for user `45253411713c4ea0aca0462c52d3e6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:25.713086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-db7b3c11-d331-4f7b-9e60-641a047223d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:25.863649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 819/1634] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:25 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:25.880387 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b3c11-d331-4f7b-9e60-641a047223d4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:25.902070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 816/1635] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 14:55:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:55:25.918891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfe69a-7036-4574-b230-7b1e4c8ac1e6 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:25.985753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:26.031271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b3c11-d331-4f7b-9e60-641a047223d4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:26.048024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ed5c0-d10e-4571-8657-f2400929e9dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:26.050763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ed5c0-d10e-4571-8657-f2400929e9dc service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:26.051057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ed5c0-d10e-4571-8657-f2400929e9dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:26.052286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ed5c0-d10e-4571-8657-f2400929e9dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:26.085838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfe69a-7036-4574-b230-7b1e4c8ac1e6 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:26.086338 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ed5c0-d10e-4571-8657-f2400929e9dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:26.090157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ed5c0-d10e-4571-8657-f2400929e9dc service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:26.092682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e7006-405c-4fa0-ae78-92f8fd133317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:26.093378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7006-405c-4fa0-ae78-92f8fd133317 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:26.093660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7006-405c-4fa0-ae78-92f8fd133317 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:26.093970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7006-405c-4fa0-ae78-92f8fd133317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:26.116925 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e7006-405c-4fa0-ae78-92f8fd133317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:26.117479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 820/1636] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:25 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:26.119372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e7006-405c-4fa0-ae78-92f8fd133317 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:26.158518 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 817/1637] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:55:26.347452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ed5c0-d10e-4571-8657-f2400929e9dc service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:26.358782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ed5c0-d10e-4571-8657-f2400929e9dc service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:26.368579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ee8e-ffbe-4cbe-a201-dffa5f1c83a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:26.373876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ee8e-ffbe-4cbe-a201-dffa5f1c83a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:26.374205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ee8e-ffbe-4cbe-a201-dffa5f1c83a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:26.377920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ee8e-ffbe-4cbe-a201-dffa5f1c83a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:26.411566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:26.531387 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6ee8e-ffbe-4cbe-a201-dffa5f1c83a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:26.532914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6ee8e-ffbe-4cbe-a201-dffa5f1c83a6 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:26.553987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 821/1638] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:26 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:27.536843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e8889-2c54-443c-a929-d95610001029 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:27.537369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e8889-2c54-443c-a929-d95610001029 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:27.537451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e8889-2c54-443c-a929-d95610001029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:27.579907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-1e0e8889-2c54-443c-a929-d95610001029 None None] MFA Rules not processed for user `dee8a9eb135a4e53bf88747bb24c4bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:27.582313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1e0e8889-2c54-443c-a929-d95610001029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:27.674293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fd4aa-0a04-441c-ba80-963510f2725a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:27.675005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fd4aa-0a04-441c-ba80-963510f2725a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:27.675602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fd4aa-0a04-441c-ba80-963510f2725a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:27.677988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 822/1639] 10.222.0.81 () {54 vars in 961 bytes} [Thu Jun 16 14:55:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:55:27.686525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c5b5e-b84b-44ab-9fce-1a839b697e2a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:27.686813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c5b5e-b84b-44ab-9fce-1a839b697e2a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:27.687093 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c5b5e-b84b-44ab-9fce-1a839b697e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:27.725099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-999c5b5e-b84b-44ab-9fce-1a839b697e2a None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:27.726305 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-999c5b5e-b84b-44ab-9fce-1a839b697e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:27.756364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 818/1640] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:27.757291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e8889-2c54-443c-a929-d95610001029 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:27.759255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 823/1641] 10.222.0.81 () {58 vars in 1058 bytes} [Thu Jun 16 14:55:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:55:27.774761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b620ca5-e738-460b-870b-f1ca04d5de47 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:27.775053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b620ca5-e738-460b-870b-f1ca04d5de47 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:27.775335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b620ca5-e738-460b-870b-f1ca04d5de47 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:27.776901 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 824/1642] 10.222.0.81 () {54 vars in 912 bytes} [Thu Jun 16 14:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:55:27.784884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e606bd-0bce-426e-a0f8-3912dab7adb7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:27.785249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e606bd-0bce-426e-a0f8-3912dab7adb7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:27.785596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e606bd-0bce-426e-a0f8-3912dab7adb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:27.820423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a7e606bd-0bce-426e-a0f8-3912dab7adb7 None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:27.825782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a7e606bd-0bce-426e-a0f8-3912dab7adb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:27.859114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 825/1643] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 14:55:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:27.860339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e606bd-0bce-426e-a0f8-3912dab7adb7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:27.876924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e606bd-0bce-426e-a0f8-3912dab7adb7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:27.886716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce39ed6-bf46-4a81-85a2-876db420dc9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:27.887402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce39ed6-bf46-4a81-85a2-876db420dc9f service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:27.887685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce39ed6-bf46-4a81-85a2-876db420dc9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:27.887960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce39ed6-bf46-4a81-85a2-876db420dc9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:27.917124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e8889-2c54-443c-a929-d95610001029 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:27.919607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce39ed6-bf46-4a81-85a2-876db420dc9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:27.922524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce39ed6-bf46-4a81-85a2-876db420dc9f service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:27.935812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b95a4-07f8-4124-93db-c9ce65cf03a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:27.937589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b95a4-07f8-4124-93db-c9ce65cf03a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:27.938419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b95a4-07f8-4124-93db-c9ce65cf03a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:27.938881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b95a4-07f8-4124-93db-c9ce65cf03a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:27.941958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b95a4-07f8-4124-93db-c9ce65cf03a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:27.944147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b95a4-07f8-4124-93db-c9ce65cf03a6 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:28.011014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 826/1644] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:28.034940 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 819/1645] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:27 2022] POST /identity/v3/projects => generated 403 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:28.036727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce39ed6-bf46-4a81-85a2-876db420dc9f service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:28.063672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce39ed6-bf46-4a81-85a2-876db420dc9f service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:28.231512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969b92f-7a77-4947-9753-3787c0449d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:28.232276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969b92f-7a77-4947-9753-3787c0449d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:28.232495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969b92f-7a77-4947-9753-3787c0449d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:28.232776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969b92f-7a77-4947-9753-3787c0449d83 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:28.233475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969b92f-7a77-4947-9753-3787c0449d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:28.235461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969b92f-7a77-4947-9753-3787c0449d83 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:28.282283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 827/1646] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:28 2022] POST /identity/v3/users => generated 308 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:55:28.287009 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b95a4-07f8-4124-93db-c9ce65cf03a6 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:28.306939 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b95a4-07f8-4124-93db-c9ce65cf03a6 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:28.315693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a1c76-433e-4fa3-988b-e451ed731a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:28.317990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1c76-433e-4fa3-988b-e451ed731a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:28.318599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1c76-433e-4fa3-988b-e451ed731a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:28.319109 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1c76-433e-4fa3-988b-e451ed731a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:28.320017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a1c76-433e-4fa3-988b-e451ed731a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:28.321948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a1c76-433e-4fa3-988b-e451ed731a54 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:28.346649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969b92f-7a77-4947-9753-3787c0449d83 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:28.358110 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 820/1647] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:28.363784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969b92f-7a77-4947-9753-3787c0449d83 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:28.369855 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765527d7-12bc-4f9c-a9ba-4f8db202fabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:28.371313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765527d7-12bc-4f9c-a9ba-4f8db202fabd admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:28.371313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765527d7-12bc-4f9c-a9ba-4f8db202fabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:28.371522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765527d7-12bc-4f9c-a9ba-4f8db202fabd admin admin] PATH_INFO: `/v3/projects/ffc63da62c334459a1e0207fe38d25b3/users/72733765fb2d403c967029eb7c5ba9b2/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:28.397488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765527d7-12bc-4f9c-a9ba-4f8db202fabd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc63da62c334459a1e0207fe38d25b3, user_id=72733765fb2d403c967029eb7c5ba9b2, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:28.401696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765527d7-12bc-4f9c-a9ba-4f8db202fabd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:28.432715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 828/1648] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:28 2022] PUT /identity/v3/projects/ffc63da62c334459a1e0207fe38d25b3/users/72733765fb2d403c967029eb7c5ba9b2/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:55:28.437761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a1c76-433e-4fa3-988b-e451ed731a54 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:28.459289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a1c76-433e-4fa3-988b-e451ed731a54 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:28.531709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:28.621217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a7f03-913b-43b1-bb09-26db70e73810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:28.622000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a7f03-913b-43b1-bb09-26db70e73810 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:28.622216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a7f03-913b-43b1-bb09-26db70e73810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:28.622499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a7f03-913b-43b1-bb09-26db70e73810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:28.623232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a7f03-913b-43b1-bb09-26db70e73810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:28.624984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a7f03-913b-43b1-bb09-26db70e73810 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:28.638708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 821/1649] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:28.643853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765527d7-12bc-4f9c-a9ba-4f8db202fabd admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:28.664886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765527d7-12bc-4f9c-a9ba-4f8db202fabd admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:28.671396 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68353ee9-9520-49e5-a5ed-2222137ff021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:28.671652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353ee9-9520-49e5-a5ed-2222137ff021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:28.671893 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353ee9-9520-49e5-a5ed-2222137ff021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:28.672175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353ee9-9520-49e5-a5ed-2222137ff021 admin admin] PATH_INFO: `/v3/projects/ffc63da62c334459a1e0207fe38d25b3/users/72733765fb2d403c967029eb7c5ba9b2/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:28.675100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68353ee9-9520-49e5-a5ed-2222137ff021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc63da62c334459a1e0207fe38d25b3, user_id=72733765fb2d403c967029eb7c5ba9b2, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:28.679861 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68353ee9-9520-49e5-a5ed-2222137ff021 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:28.703055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 829/1650] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:28 2022] PUT /identity/v3/projects/ffc63da62c334459a1e0207fe38d25b3/users/72733765fb2d403c967029eb7c5ba9b2/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:32.611225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425234dd-e4b2-4c98-af41-6a6fd7c09687 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:32.611736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425234dd-e4b2-4c98-af41-6a6fd7c09687 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:32.611811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425234dd-e4b2-4c98-af41-6a6fd7c09687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:32.694676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-425234dd-e4b2-4c98-af41-6a6fd7c09687 None None] MFA Rules not processed for user `72733765fb2d403c967029eb7c5ba9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:32.695970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-425234dd-e4b2-4c98-af41-6a6fd7c09687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:32.983587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 822/1651] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:34.154955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68353ee9-9520-49e5-a5ed-2222137ff021 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:34.238652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:34.293329 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68353ee9-9520-49e5-a5ed-2222137ff021 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:34.308702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:34.309615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:34.309922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:34.310203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] PATH_INFO: `/v3/users/370720ef354f4ae79383c6e34208d273` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:34.311452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=370720ef354f4ae79383c6e34208d273)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:34.313404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:34.419809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370720ef354f4ae79383c6e34208d273'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:34.420269 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370720ef354f4ae79383c6e34208d273'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:34.420899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370720ef354f4ae79383c6e34208d273'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:34.442046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370720ef354f4ae79383c6e34208d273'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:34.452282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370720ef354f4ae79383c6e34208d273'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:34.542135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 830/1652] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:55:34 2022] DELETE /identity/v3/users/370720ef354f4ae79383c6e34208d273 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:34.543748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00f76d-4a6d-43ef-88f7-fd50d956605b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:34.544234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00f76d-4a6d-43ef-88f7-fd50d956605b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:34.544455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00f76d-4a6d-43ef-88f7-fd50d956605b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:34.591515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5b00f76d-4a6d-43ef-88f7-fd50d956605b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:34.604866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5b00f76d-4a6d-43ef-88f7-fd50d956605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:34.770185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 823/1653] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:34.874056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:34.875932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:35.070355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953afc1-12dc-4f7d-a07d-e076fffbe908 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:35.076128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350fce5-63df-4535-9054-256f39b97c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:35.076825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350fce5-63df-4535-9054-256f39b97c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:35.077119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350fce5-63df-4535-9054-256f39b97c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:35.077399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350fce5-63df-4535-9054-256f39b97c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:35.108472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350fce5-63df-4535-9054-256f39b97c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:35.109967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350fce5-63df-4535-9054-256f39b97c5e service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:35.130605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 831/1654] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:37.395338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00f76d-4a6d-43ef-88f7-fd50d956605b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:37.397538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5b00f76d-4a6d-43ef-88f7-fd50d956605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:37.419663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00f76d-4a6d-43ef-88f7-fd50d956605b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:37.429749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:37.432476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:37.432771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:37.433075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] PATH_INFO: `/v3/projects/a3994949ab10416c93c40a2de93cac04` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:37.436460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3994949ab10416c93c40a2de93cac04)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:37.443427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:37.445822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a3391-10b7-49f2-a954-9b498fb9f1a4 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:37.446652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a3391-10b7-49f2-a954-9b498fb9f1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:37.447072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a3391-10b7-49f2-a954-9b498fb9f1a4 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:37.448913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 832/1655] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 14:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:37.469838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc033-8c7b-4595-a80e-c1b58377fa78 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:37.470577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc033-8c7b-4595-a80e-c1b58377fa78 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:37.471139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc033-8c7b-4595-a80e-c1b58377fa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:37.518056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5dbcc033-8c7b-4595-a80e-c1b58377fa78 None None] MFA Rules not processed for user `57eebea8e2f6424d805d9b84c222b222`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:37.519766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5dbcc033-8c7b-4595-a80e-c1b58377fa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:37.558930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:37.572333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3994949ab10416c93c40a2de93cac04', 'request_id': 'req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:37.590003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3994949ab10416c93c40a2de93cac04', 'request_id': 'req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:37.604996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3994949ab10416c93c40a2de93cac04', 'request_id': 'req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:37.642394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] The token cache is being invalidate because project a3994949ab10416c93c40a2de93cac04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:55:37.643920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:37.646055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-08f9c3a6-0851-4b1c-83d7-9cd9987d8e91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:37.655027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 824/1656] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:55:37 2022] DELETE /identity/v3/projects/a3994949ab10416c93c40a2de93cac04 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:37.668535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efcf23-3250-442a-95d9-87f080869e4b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:37.669298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efcf23-3250-442a-95d9-87f080869e4b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:37.669735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efcf23-3250-442a-95d9-87f080869e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:37.678288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:37.725780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 833/1657] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:37.726643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-40efcf23-3250-442a-95d9-87f080869e4b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:37.728566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-40efcf23-3250-442a-95d9-87f080869e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:37.785735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87bc6c-912d-495a-abe3-bd946951535d None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:37.786051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87bc6c-912d-495a-abe3-bd946951535d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:37.786332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87bc6c-912d-495a-abe3-bd946951535d None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:37.787753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 834/1658] 10.222.0.81 () {54 vars in 960 bytes} [Thu Jun 16 14:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:55:37.793221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42493b25-65fb-4426-881e-ac39ccac0755 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:37.793528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42493b25-65fb-4426-881e-ac39ccac0755 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:37.793796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42493b25-65fb-4426-881e-ac39ccac0755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:37.879902 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-42493b25-65fb-4426-881e-ac39ccac0755 None None] MFA Rules not processed for user `57eebea8e2f6424d805d9b84c222b222`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:37.881133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-42493b25-65fb-4426-881e-ac39ccac0755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:37.927881 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 835/1659] 10.222.0.81 () {58 vars in 1057 bytes} [Thu Jun 16 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:37.929792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b96cd-a5ce-4436-8ac1-a916a989b9bc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:37.930376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b96cd-a5ce-4436-8ac1-a916a989b9bc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:37.930653 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b96cd-a5ce-4436-8ac1-a916a989b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:37.970178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 825/1660] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:37.971080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efcf23-3250-442a-95d9-87f080869e4b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:37.994603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d09b96cd-a5ce-4436-8ac1-a916a989b9bc None None] MFA Rules not processed for user `84263576aaec455a91b6035cc5dca4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:37.996097 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d09b96cd-a5ce-4436-8ac1-a916a989b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:38.001379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efcf23-3250-442a-95d9-87f080869e4b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:38.015595 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f3e43-324a-4264-be68-c5aedc9eca76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:38.016617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f3e43-324a-4264-be68-c5aedc9eca76 service placement] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:38.016617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f3e43-324a-4264-be68-c5aedc9eca76 service placement] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:38.016808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f3e43-324a-4264-be68-c5aedc9eca76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:38.042963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f3e43-324a-4264-be68-c5aedc9eca76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:38.044744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f3e43-324a-4264-be68-c5aedc9eca76 service placement] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:38.065957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 826/1661] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:38.067297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7ed75-9098-41e7-a72c-c0dc39452870 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:38.078731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7ed75-9098-41e7-a72c-c0dc39452870 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:38.079025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7ed75-9098-41e7-a72c-c0dc39452870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:38.112975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-0dc7ed75-9098-41e7-a72c-c0dc39452870 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:38.117679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0dc7ed75-9098-41e7-a72c-c0dc39452870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:38.140299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 827/1662] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:38.141346 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7ed75-9098-41e7-a72c-c0dc39452870 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:38.161643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 836/1663] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:38.165242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7ed75-9098-41e7-a72c-c0dc39452870 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:38.173965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182c7cc-768f-4cd1-8798-569e633b566b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:38.174818 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182c7cc-768f-4cd1-8798-569e633b566b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:38.175393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182c7cc-768f-4cd1-8798-569e633b566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:38.187580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c39d99-bb6f-4665-b33d-e3a64195e197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:38.191986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c39d99-bb6f-4665-b33d-e3a64195e197 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:38.193728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c39d99-bb6f-4665-b33d-e3a64195e197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:38.194159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c39d99-bb6f-4665-b33d-e3a64195e197 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:38.195273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c39d99-bb6f-4665-b33d-e3a64195e197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:38.195842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c39d99-bb6f-4665-b33d-e3a64195e197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:38.199319 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c39d99-bb6f-4665-b33d-e3a64195e197 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:38.228505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1182c7cc-768f-4cd1-8798-569e633b566b None None] MFA Rules not processed for user `84263576aaec455a91b6035cc5dca4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:38.231376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1182c7cc-768f-4cd1-8798-569e633b566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:38.250267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 828/1664] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:55:38.255309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c39d99-bb6f-4665-b33d-e3a64195e197 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:38.274095 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 837/1665] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:55:38.282280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182c7cc-768f-4cd1-8798-569e633b566b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:38.284866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1182c7cc-768f-4cd1-8798-569e633b566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:38.297383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c39d99-bb6f-4665-b33d-e3a64195e197 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:38.321840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826e348-76c6-4df8-8b44-45fa978aaf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:38.324201 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826e348-76c6-4df8-8b44-45fa978aaf06 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:38.329321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826e348-76c6-4df8-8b44-45fa978aaf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:38.330536 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826e348-76c6-4df8-8b44-45fa978aaf06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:38.333096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826e348-76c6-4df8-8b44-45fa978aaf06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:38.342542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826e348-76c6-4df8-8b44-45fa978aaf06 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:38.448039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 829/1666] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:38 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:38.453359 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826e348-76c6-4df8-8b44-45fa978aaf06 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:38.586684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182c7cc-768f-4cd1-8798-569e633b566b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:38.683478 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826e348-76c6-4df8-8b44-45fa978aaf06 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:38.708134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77aef31-bd07-4fa7-b8ae-c2b1d511de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:38.712772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77aef31-bd07-4fa7-b8ae-c2b1d511de21 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:38.714297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77aef31-bd07-4fa7-b8ae-c2b1d511de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:38.714774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77aef31-bd07-4fa7-b8ae-c2b1d511de21 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:38.716069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77aef31-bd07-4fa7-b8ae-c2b1d511de21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:38.722591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77aef31-bd07-4fa7-b8ae-c2b1d511de21 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:38.808660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 830/1667] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:38 2022] POST /identity/v3/users => generated 291 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:38.809760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77aef31-bd07-4fa7-b8ae-c2b1d511de21 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:38.832185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77aef31-bd07-4fa7-b8ae-c2b1d511de21 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:38.847671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf785a1-1759-4e64-9edf-e2659e6c19d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:38.848792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf785a1-1759-4e64-9edf-e2659e6c19d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:38.849126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf785a1-1759-4e64-9edf-e2659e6c19d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:38.849518 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf785a1-1759-4e64-9edf-e2659e6c19d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:38.850409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf785a1-1759-4e64-9edf-e2659e6c19d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:38.852178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf785a1-1759-4e64-9edf-e2659e6c19d4 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:38.857598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:38.875524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab27208-e92c-442c-81e4-2486122d2eaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:38.880806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab27208-e92c-442c-81e4-2486122d2eaa service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:38.881420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab27208-e92c-442c-81e4-2486122d2eaa service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:38.881839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab27208-e92c-442c-81e4-2486122d2eaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:38.883678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 831/1668] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:38.887365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf785a1-1759-4e64-9edf-e2659e6c19d4 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:38.895750 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:38.913338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf785a1-1759-4e64-9edf-e2659e6c19d4 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:38.927102 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254f2a0-a603-444c-80e2-b32651e3e88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:38.928294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254f2a0-a603-444c-80e2-b32651e3e88a admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:38.929214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254f2a0-a603-444c-80e2-b32651e3e88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:38.937561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254f2a0-a603-444c-80e2-b32651e3e88a admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:38.938793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254f2a0-a603-444c-80e2-b32651e3e88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:38.941248 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254f2a0-a603-444c-80e2-b32651e3e88a admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:38.974334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 832/1669] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:38.978274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254f2a0-a603-444c-80e2-b32651e3e88a admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:39.007634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254f2a0-a603-444c-80e2-b32651e3e88a admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:39.023578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b32f6e-389c-44c1-83aa-6fc21f5cad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:39.026064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b32f6e-389c-44c1-83aa-6fc21f5cad56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:39.026479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b32f6e-389c-44c1-83aa-6fc21f5cad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:39.027090 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b32f6e-389c-44c1-83aa-6fc21f5cad56 admin admin] PATH_INFO: `/v3/projects/d12fdf0ad0c54d3db329611a820e3ee1/users/dd576e1d4de14d1dbdd9005e007dee14/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:39.055228 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab27208-e92c-442c-81e4-2486122d2eaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:39.060342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab27208-e92c-442c-81e4-2486122d2eaa service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:39.076870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b32f6e-389c-44c1-83aa-6fc21f5cad56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12fdf0ad0c54d3db329611a820e3ee1, user_id=dd576e1d4de14d1dbdd9005e007dee14, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:39.079835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b32f6e-389c-44c1-83aa-6fc21f5cad56 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:39.106027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 838/1670] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 825 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:55:39.119996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 833/1671] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:38 2022] PUT /identity/v3/projects/d12fdf0ad0c54d3db329611a820e3ee1/users/dd576e1d4de14d1dbdd9005e007dee14/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:39.140375 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64690e-1bfb-4e4a-bbb7-3e6bf8409757 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:39.143825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64690e-1bfb-4e4a-bbb7-3e6bf8409757 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:39.144267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64690e-1bfb-4e4a-bbb7-3e6bf8409757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:39.230966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8b64690e-1bfb-4e4a-bbb7-3e6bf8409757 None None] MFA Rules not processed for user `dd576e1d4de14d1dbdd9005e007dee14`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:39.232548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8b64690e-1bfb-4e4a-bbb7-3e6bf8409757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:39.380166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 839/1672] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:39.384401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b32f6e-389c-44c1-83aa-6fc21f5cad56 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:39.520648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b32f6e-389c-44c1-83aa-6fc21f5cad56 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:39.525925 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683599dc-223c-40b0-9a7d-281c7a5cc634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:39.526617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683599dc-223c-40b0-9a7d-281c7a5cc634 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:39.526908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683599dc-223c-40b0-9a7d-281c7a5cc634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:39.527338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683599dc-223c-40b0-9a7d-281c7a5cc634 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:39.528126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683599dc-223c-40b0-9a7d-281c7a5cc634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:39.530299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683599dc-223c-40b0-9a7d-281c7a5cc634 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:39.584045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 834/1673] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:39 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:55:39.587883 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64690e-1bfb-4e4a-bbb7-3e6bf8409757 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:39.603804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64690e-1bfb-4e4a-bbb7-3e6bf8409757 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:39.729111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea021cc-f7de-4317-9067-bceea05ddbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:39.730416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea021cc-f7de-4317-9067-bceea05ddbca admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:39.730879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea021cc-f7de-4317-9067-bceea05ddbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:39.731522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea021cc-f7de-4317-9067-bceea05ddbca admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:39.732669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea021cc-f7de-4317-9067-bceea05ddbca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:39.736792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea021cc-f7de-4317-9067-bceea05ddbca admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:39.781755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683599dc-223c-40b0-9a7d-281c7a5cc634 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:39.786309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 840/1674] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:39 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:39.798922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683599dc-223c-40b0-9a7d-281c7a5cc634 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:39.807630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607409f-84d0-413b-bde3-d96be9826574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:39.808813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607409f-84d0-413b-bde3-d96be9826574 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:39.809236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607409f-84d0-413b-bde3-d96be9826574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:39.809802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607409f-84d0-413b-bde3-d96be9826574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:39.810903 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607409f-84d0-413b-bde3-d96be9826574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:39.812929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607409f-84d0-413b-bde3-d96be9826574 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:39.835433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 835/1675] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:39.836991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea021cc-f7de-4317-9067-bceea05ddbca admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:39.851492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea021cc-f7de-4317-9067-bceea05ddbca admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:39.865942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2206e-de62-4237-9ccf-037488110261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:39.868056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2206e-de62-4237-9ccf-037488110261 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:39.868354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2206e-de62-4237-9ccf-037488110261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:39.868766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2206e-de62-4237-9ccf-037488110261 admin admin] PATH_INFO: `/v3/projects/54cd2213eb0041319b0d7ab3cf22844f/users/779cc2e8f26344a28598f3a3dfb91ea0/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:39.928018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2206e-de62-4237-9ccf-037488110261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cd2213eb0041319b0d7ab3cf22844f, user_id=779cc2e8f26344a28598f3a3dfb91ea0, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:39.930844 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2206e-de62-4237-9ccf-037488110261 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:39.954474 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:39.983306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 841/1676] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:39 2022] PUT /identity/v3/projects/54cd2213eb0041319b0d7ab3cf22844f/users/779cc2e8f26344a28598f3a3dfb91ea0/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:39.984568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607409f-84d0-413b-bde3-d96be9826574 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:40.005861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607409f-84d0-413b-bde3-d96be9826574 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:40.146060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bfa32-fad4-4eb9-b262-7e103c67f09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:40.146757 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bfa32-fad4-4eb9-b262-7e103c67f09b admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:40.147034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bfa32-fad4-4eb9-b262-7e103c67f09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:40.147309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bfa32-fad4-4eb9-b262-7e103c67f09b admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:40.148037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bfa32-fad4-4eb9-b262-7e103c67f09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:40.151197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bfa32-fad4-4eb9-b262-7e103c67f09b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:40.178071 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2206e-de62-4237-9ccf-037488110261 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:40.178924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 836/1677] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:40.209416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2206e-de62-4237-9ccf-037488110261 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:40.227951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3ec2-cace-47a6-b82d-03623bb1f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:40.228873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3ec2-cace-47a6-b82d-03623bb1f71c admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:40.229152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3ec2-cace-47a6-b82d-03623bb1f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:40.229427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3ec2-cace-47a6-b82d-03623bb1f71c admin admin] PATH_INFO: `/v3/projects/54cd2213eb0041319b0d7ab3cf22844f/users/779cc2e8f26344a28598f3a3dfb91ea0/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:40.233836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3ec2-cace-47a6-b82d-03623bb1f71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cd2213eb0041319b0d7ab3cf22844f, user_id=779cc2e8f26344a28598f3a3dfb91ea0, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:40.247805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3ec2-cace-47a6-b82d-03623bb1f71c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:40.274595 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 842/1678] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:40 2022] PUT /identity/v3/projects/54cd2213eb0041319b0d7ab3cf22844f/users/779cc2e8f26344a28598f3a3dfb91ea0/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:40.286837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ee16-1d25-42bf-9447-4ee704e88821 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:40.287123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ee16-1d25-42bf-9447-4ee704e88821 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:40.287409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ee16-1d25-42bf-9447-4ee704e88821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:40.321034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b33fb-2e40-408c-9461-c6eaf0754fc3 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:40.321323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b33fb-2e40-408c-9461-c6eaf0754fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:40.321600 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b33fb-2e40-408c-9461-c6eaf0754fc3 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:40.323853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 843/1679] 10.222.0.81 () {54 vars in 912 bytes} [Thu Jun 16 14:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:40.336555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2afc4-5a65-44bb-be77-8af3cc270e18 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:40.336934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2afc4-5a65-44bb-be77-8af3cc270e18 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:40.337381 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2afc4-5a65-44bb-be77-8af3cc270e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:40.353271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-08c5ee16-1d25-42bf-9447-4ee704e88821 None None] MFA Rules not processed for user `779cc2e8f26344a28598f3a3dfb91ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:40.359407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-08c5ee16-1d25-42bf-9447-4ee704e88821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:40.433838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:40.453829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d9a2afc4-5a65-44bb-be77-8af3cc270e18 None None] MFA Rules not processed for user `8940bddd49534f01a8b1bf1dee644216`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:40.459026 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d9a2afc4-5a65-44bb-be77-8af3cc270e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:40.583989 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 844/1680] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:55:40.617249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 837/1681] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:40.618688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2afc4-5a65-44bb-be77-8af3cc270e18 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:40.620819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d9a2afc4-5a65-44bb-be77-8af3cc270e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:40.773712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ee16-1d25-42bf-9447-4ee704e88821 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:40.775105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-08c5ee16-1d25-42bf-9447-4ee704e88821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:40.797253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2afc4-5a65-44bb-be77-8af3cc270e18 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:40.798996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ee16-1d25-42bf-9447-4ee704e88821 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:40.811433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322596ee-0af3-44b2-a220-d81120386e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:40.812109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322596ee-0af3-44b2-a220-d81120386e39 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:40.812492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322596ee-0af3-44b2-a220-d81120386e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:40.812789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322596ee-0af3-44b2-a220-d81120386e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:40.818685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f4e58-b26a-47af-8b16-a2e069371c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:40.820005 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f4e58-b26a-47af-8b16-a2e069371c98 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:40.820292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f4e58-b26a-47af-8b16-a2e069371c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:40.820570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f4e58-b26a-47af-8b16-a2e069371c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:40.852662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f4e58-b26a-47af-8b16-a2e069371c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:40.866891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322596ee-0af3-44b2-a220-d81120386e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:40.868217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f4e58-b26a-47af-8b16-a2e069371c98 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:40.872459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322596ee-0af3-44b2-a220-d81120386e39 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:40.890392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 838/1682] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:40.906631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 845/1683] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:41.078485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f4e58-b26a-47af-8b16-a2e069371c98 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:41.097112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f4e58-b26a-47af-8b16-a2e069371c98 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:41.107150 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18471eb-faa1-4b12-a64f-008b2bbda4e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:41.107997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18471eb-faa1-4b12-a64f-008b2bbda4e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:41.108417 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18471eb-faa1-4b12-a64f-008b2bbda4e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:41.108828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18471eb-faa1-4b12-a64f-008b2bbda4e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:41.254445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18471eb-faa1-4b12-a64f-008b2bbda4e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:41.257653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18471eb-faa1-4b12-a64f-008b2bbda4e5 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:41.275099 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 839/1684] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:41.683831 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeaf74-621d-4168-8933-f280982b555e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:41.684296 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeaf74-621d-4168-8933-f280982b555e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:41.684521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeaf74-621d-4168-8933-f280982b555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:41.800644 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-17aeaf74-621d-4168-8933-f280982b555e None None] MFA Rules not processed for user `561c947ee70e4521b594f0d528e6e6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:41.804719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-17aeaf74-621d-4168-8933-f280982b555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:41.950907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c8d22-b776-45d8-932f-967c8cea5fb0 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:41.952376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c8d22-b776-45d8-932f-967c8cea5fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:41.952860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c8d22-b776-45d8-932f-967c8cea5fb0 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:41.954951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 840/1685] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 14:55:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:42.039707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255c4d2-014c-4539-a0a4-1b890ea78dd7 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:42.039998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255c4d2-014c-4539-a0a4-1b890ea78dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:42.040275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255c4d2-014c-4539-a0a4-1b890ea78dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:42.099540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 846/1686] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:42.103340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a255c4d2-014c-4539-a0a4-1b890ea78dd7 None None] MFA Rules not processed for user `57eebea8e2f6424d805d9b84c222b222`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:42.104787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a255c4d2-014c-4539-a0a4-1b890ea78dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:42.119051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aeaf74-621d-4168-8933-f280982b555e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:42.120755 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-17aeaf74-621d-4168-8933-f280982b555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:42.186777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:42.324008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 841/1687] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 14:55:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:42.325064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255c4d2-014c-4539-a0a4-1b890ea78dd7 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:42.326728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a255c4d2-014c-4539-a0a4-1b890ea78dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:42.356395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aeaf74-621d-4168-8933-f280982b555e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:42.375125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e21e2-2aea-4b93-84a4-0e175456fc81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:42.376239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e21e2-2aea-4b93-84a4-0e175456fc81 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:42.376629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e21e2-2aea-4b93-84a4-0e175456fc81 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:42.377011 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e21e2-2aea-4b93-84a4-0e175456fc81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:42.392966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e21e2-2aea-4b93-84a4-0e175456fc81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:42.397448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e21e2-2aea-4b93-84a4-0e175456fc81 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:42.423668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 847/1688] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:42.426301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:42.491208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255c4d2-014c-4539-a0a4-1b890ea78dd7 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:42.509145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:42.510237 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:42.510379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:42.510625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] PATH_INFO: `/v3/users/dee8a9eb135a4e53bf88747bb24c4bc2` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:42.513240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee8a9eb135a4e53bf88747bb24c4bc2)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:42.514336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: WARNING py.warnings [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:55:42.514336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: warnings.warn(msg) Jun 16 14:55:42.514336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: Jun 16 14:55:42.525540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:42.568820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e21e2-2aea-4b93-84a4-0e175456fc81 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:42.588713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e21e2-2aea-4b93-84a4-0e175456fc81 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:42.610366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558fd1d-52b2-483f-ac36-cb916dcbc00d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:42.611044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558fd1d-52b2-483f-ac36-cb916dcbc00d service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:42.611378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558fd1d-52b2-483f-ac36-cb916dcbc00d service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:42.611837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558fd1d-52b2-483f-ac36-cb916dcbc00d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:42.660808 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558fd1d-52b2-483f-ac36-cb916dcbc00d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:42.662339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558fd1d-52b2-483f-ac36-cb916dcbc00d service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:42.681876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee8a9eb135a4e53bf88747bb24c4bc2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:42.700491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 848/1689] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:55:42.737675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee8a9eb135a4e53bf88747bb24c4bc2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:42.817826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee8a9eb135a4e53bf88747bb24c4bc2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:42.825539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee8a9eb135a4e53bf88747bb24c4bc2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:42.849785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ef731e2e-dfe0-4873-b254-069e79312d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee8a9eb135a4e53bf88747bb24c4bc2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:42.865374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 842/1690] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:55:42 2022] DELETE /identity/v3/users/dee8a9eb135a4e53bf88747bb24c4bc2 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:43.090450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558fd1d-52b2-483f-ac36-cb916dcbc00d service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:43.111479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558fd1d-52b2-483f-ac36-cb916dcbc00d service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:43.226842 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8865ae9-c17a-472d-a2d8-e46060a8ff38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:43.227530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8865ae9-c17a-472d-a2d8-e46060a8ff38 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:43.227988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8865ae9-c17a-472d-a2d8-e46060a8ff38 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:43.228275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8865ae9-c17a-472d-a2d8-e46060a8ff38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:43.230400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f8865ae9-c17a-472d-a2d8-e46060a8ff38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:43.256673 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8865ae9-c17a-472d-a2d8-e46060a8ff38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:43.258515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8865ae9-c17a-472d-a2d8-e46060a8ff38 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:43.314451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 849/1691] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:43.530325 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe6a0d-7c37-491c-9a21-834fc9c95c01 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:43.530870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe6a0d-7c37-491c-9a21-834fc9c95c01 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:43.530870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe6a0d-7c37-491c-9a21-834fc9c95c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:43.629110 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-1cfe6a0d-7c37-491c-9a21-834fc9c95c01 None None] MFA Rules not processed for user `765e8ba07bc1465fa3ce3444d05ad36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:43.631163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1cfe6a0d-7c37-491c-9a21-834fc9c95c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:43.930144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 843/1692] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:43.946750 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8865ae9-c17a-472d-a2d8-e46060a8ff38 service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:43.949278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f8865ae9-c17a-472d-a2d8-e46060a8ff38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:44.178476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe6a0d-7c37-491c-9a21-834fc9c95c01 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:44.186455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1cfe6a0d-7c37-491c-9a21-834fc9c95c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:44.199122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8865ae9-c17a-472d-a2d8-e46060a8ff38 service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:44.217238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d258b-e427-4838-9d11-c4881762b554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:44.220871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d258b-e427-4838-9d11-c4881762b554 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:44.223006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d258b-e427-4838-9d11-c4881762b554 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:44.223459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d258b-e427-4838-9d11-c4881762b554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:44.244579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d258b-e427-4838-9d11-c4881762b554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:44.248813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d258b-e427-4838-9d11-c4881762b554 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:44.288039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 850/1693] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:44.503703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:44.528809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d258b-e427-4838-9d11-c4881762b554 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:44.530279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b66d258b-e427-4838-9d11-c4881762b554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:44.543474 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:44.566192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe6a0d-7c37-491c-9a21-834fc9c95c01 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:44.593224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d258b-e427-4838-9d11-c4881762b554 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:44.603768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:44.604665 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:44.604945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:44.605222 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] PATH_INFO: `/v3/projects/f81d00af3114481bba69aef5d4e23223` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:44.608734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81d00af3114481bba69aef5d4e23223)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:44.610764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:44.613038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54275316-6b17-4a9b-a67c-583fde3518eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:44.616546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54275316-6b17-4a9b-a67c-583fde3518eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:44.617172 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54275316-6b17-4a9b-a67c-583fde3518eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:44.617480 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54275316-6b17-4a9b-a67c-583fde3518eb admin admin] PATH_INFO: `/v3/users/dd576e1d4de14d1dbdd9005e007dee14` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:44.624265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54275316-6b17-4a9b-a67c-583fde3518eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd576e1d4de14d1dbdd9005e007dee14)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:44.628815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54275316-6b17-4a9b-a67c-583fde3518eb admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:44.770118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-54275316-6b17-4a9b-a67c-583fde3518eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd576e1d4de14d1dbdd9005e007dee14'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:44.771047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-54275316-6b17-4a9b-a67c-583fde3518eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd576e1d4de14d1dbdd9005e007dee14'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:44.772561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-54275316-6b17-4a9b-a67c-583fde3518eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd576e1d4de14d1dbdd9005e007dee14'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:44.789201 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-54275316-6b17-4a9b-a67c-583fde3518eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd576e1d4de14d1dbdd9005e007dee14'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:44.809895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-54275316-6b17-4a9b-a67c-583fde3518eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd576e1d4de14d1dbdd9005e007dee14'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:44.862275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 851/1694] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:55:44 2022] DELETE /identity/v3/users/dd576e1d4de14d1dbdd9005e007dee14 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:44.863794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06507-4101-4aeb-99f4-00014a801267 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:44.864090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06507-4101-4aeb-99f4-00014a801267 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:44.865790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06507-4101-4aeb-99f4-00014a801267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:44.911097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81d00af3114481bba69aef5d4e23223', 'request_id': 'req-c2d28ad3-f18b-47cb-912d-418f03d0b18b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:44.911230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e7e06507-4101-4aeb-99f4-00014a801267 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:44.912371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e7e06507-4101-4aeb-99f4-00014a801267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:44.936995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81d00af3114481bba69aef5d4e23223', 'request_id': 'req-c2d28ad3-f18b-47cb-912d-418f03d0b18b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:44.958756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81d00af3114481bba69aef5d4e23223', 'request_id': 'req-c2d28ad3-f18b-47cb-912d-418f03d0b18b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:44.992619 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] The token cache is being invalidate because project f81d00af3114481bba69aef5d4e23223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:55:44.993369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:44.997358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:45.003784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 844/1695] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:55:44 2022] DELETE /identity/v3/projects/f81d00af3114481bba69aef5d4e23223 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:45.006374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:45.009046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:45.093066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 852/1696] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:55:45.148792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e06507-4101-4aeb-99f4-00014a801267 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:45.150414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e7e06507-4101-4aeb-99f4-00014a801267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:45.187565 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d28ad3-f18b-47cb-912d-418f03d0b18b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:45.203254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa7c94-fd11-48a8-8dea-a75ecb9dffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:45.204530 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa7c94-fd11-48a8-8dea-a75ecb9dffb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:45.206302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa7c94-fd11-48a8-8dea-a75ecb9dffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:45.209525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa7c94-fd11-48a8-8dea-a75ecb9dffb3 admin admin] PATH_INFO: `/v3/users/72733765fb2d403c967029eb7c5ba9b2` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:45.217412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa7c94-fd11-48a8-8dea-a75ecb9dffb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72733765fb2d403c967029eb7c5ba9b2)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:45.220267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa7c94-fd11-48a8-8dea-a75ecb9dffb3 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:45.308587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e06507-4101-4aeb-99f4-00014a801267 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:45.321647 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c043c-a701-4959-8bfe-393ca43d96e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:45.322435 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c043c-a701-4959-8bfe-393ca43d96e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:45.322669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c043c-a701-4959-8bfe-393ca43d96e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:45.322946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c043c-a701-4959-8bfe-393ca43d96e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:45.362742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4aaa7c94-fd11-48a8-8dea-a75ecb9dffb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72733765fb2d403c967029eb7c5ba9b2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:45.365393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c043c-a701-4959-8bfe-393ca43d96e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:45.374441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c043c-a701-4959-8bfe-393ca43d96e4 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:45.384648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4aaa7c94-fd11-48a8-8dea-a75ecb9dffb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72733765fb2d403c967029eb7c5ba9b2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:45.422046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4aaa7c94-fd11-48a8-8dea-a75ecb9dffb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72733765fb2d403c967029eb7c5ba9b2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:45.427165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 853/1697] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:45.430445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4aaa7c94-fd11-48a8-8dea-a75ecb9dffb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72733765fb2d403c967029eb7c5ba9b2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:45.447399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4aaa7c94-fd11-48a8-8dea-a75ecb9dffb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72733765fb2d403c967029eb7c5ba9b2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:45.449150 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:45.461441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 845/1698] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:55:45 2022] DELETE /identity/v3/users/72733765fb2d403c967029eb7c5ba9b2 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:45.980769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9007174-9d16-4978-b1d5-5ffd289947ec None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:45.981150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9007174-9d16-4978-b1d5-5ffd289947ec None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:45.981599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9007174-9d16-4978-b1d5-5ffd289947ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:46.084876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c9007174-9d16-4978-b1d5-5ffd289947ec None None] MFA Rules not processed for user `555dc188a72647f3af56b774d04ab4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:46.093635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c9007174-9d16-4978-b1d5-5ffd289947ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:46.115609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:46.289755 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 854/1699] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:46.302986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57193fb-1500-4591-a677-4bcca975a6a3 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:46.303501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57193fb-1500-4591-a677-4bcca975a6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:46.303781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57193fb-1500-4591-a677-4bcca975a6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:46.341374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-f57193fb-1500-4591-a677-4bcca975a6a3 None None] MFA Rules not processed for user `555dc188a72647f3af56b774d04ab4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:46.348235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f57193fb-1500-4591-a677-4bcca975a6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:46.378740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 846/1700] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:46.385250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9007174-9d16-4978-b1d5-5ffd289947ec None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:46.387542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c9007174-9d16-4978-b1d5-5ffd289947ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:46.613031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9007174-9d16-4978-b1d5-5ffd289947ec None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:46.622722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d729a7-c27f-44c0-a98b-21622476876f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:46.623989 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d729a7-c27f-44c0-a98b-21622476876f service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:46.624586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d729a7-c27f-44c0-a98b-21622476876f service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:46.625086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d729a7-c27f-44c0-a98b-21622476876f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:46.648765 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d729a7-c27f-44c0-a98b-21622476876f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:46.653286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d729a7-c27f-44c0-a98b-21622476876f service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:46.680699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 855/1701] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:47.238206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a13d-2136-4249-ba6e-3d42f8eee711 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:47.238501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a13d-2136-4249-ba6e-3d42f8eee711 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:47.238789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a13d-2136-4249-ba6e-3d42f8eee711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:47.290179 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6b02a13d-2136-4249-ba6e-3d42f8eee711 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:47.292096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6b02a13d-2136-4249-ba6e-3d42f8eee711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:47.379216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d729a7-c27f-44c0-a98b-21622476876f service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:47.382032 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d4d729a7-c27f-44c0-a98b-21622476876f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:47.450356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 847/1702] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 14:55:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:47.567071 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d729a7-c27f-44c0-a98b-21622476876f service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:47.573653 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:47.574689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:47.575178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:47.575569 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] PATH_INFO: `/v3/projects/d12fdf0ad0c54d3db329611a820e3ee1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:47.578798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12fdf0ad0c54d3db329611a820e3ee1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:47.583941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: WARNING py.warnings [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:55:47.583941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: warnings.warn(msg) Jun 16 14:55:47.583941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: Jun 16 14:55:47.586127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:47.654049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:47.694318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12fdf0ad0c54d3db329611a820e3ee1', 'request_id': 'req-35706153-caed-49d0-88ac-cc5ce4a404e5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:47.714447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12fdf0ad0c54d3db329611a820e3ee1', 'request_id': 'req-35706153-caed-49d0-88ac-cc5ce4a404e5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:47.749110 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02a13d-2136-4249-ba6e-3d42f8eee711 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:47.750423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12fdf0ad0c54d3db329611a820e3ee1', 'request_id': 'req-35706153-caed-49d0-88ac-cc5ce4a404e5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:47.750964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6b02a13d-2136-4249-ba6e-3d42f8eee711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:47.779577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] The token cache is being invalidate because project d12fdf0ad0c54d3db329611a820e3ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:55:47.781091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:47.784476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:47.787512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 856/1703] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:55:47 2022] DELETE /identity/v3/projects/d12fdf0ad0c54d3db329611a820e3ee1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:47.791664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:47.795082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:47.947041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02a13d-2136-4249-ba6e-3d42f8eee711 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:47.953217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706153-caed-49d0-88ac-cc5ce4a404e5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:47.968528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940128d-39db-4d80-b72a-e3081b78c225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:47.969627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940128d-39db-4d80-b72a-e3081b78c225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:47.970075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940128d-39db-4d80-b72a-e3081b78c225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:47.970469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940128d-39db-4d80-b72a-e3081b78c225 admin admin] PATH_INFO: `/v3/users/779cc2e8f26344a28598f3a3dfb91ea0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:47.972731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940128d-39db-4d80-b72a-e3081b78c225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=779cc2e8f26344a28598f3a3dfb91ea0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:47.975003 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940128d-39db-4d80-b72a-e3081b78c225 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:48.066064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4940128d-39db-4d80-b72a-e3081b78c225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779cc2e8f26344a28598f3a3dfb91ea0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:48.067646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4940128d-39db-4d80-b72a-e3081b78c225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779cc2e8f26344a28598f3a3dfb91ea0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:48.068871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4940128d-39db-4d80-b72a-e3081b78c225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779cc2e8f26344a28598f3a3dfb91ea0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:48.086436 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4940128d-39db-4d80-b72a-e3081b78c225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779cc2e8f26344a28598f3a3dfb91ea0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:48.110450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4940128d-39db-4d80-b72a-e3081b78c225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779cc2e8f26344a28598f3a3dfb91ea0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:48.138388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9a8e0-a940-4844-8a9f-8280c7ad734c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:48.140497 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9a8e0-a940-4844-8a9f-8280c7ad734c service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.140790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9a8e0-a940-4844-8a9f-8280c7ad734c service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.141070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9a8e0-a940-4844-8a9f-8280c7ad734c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.153490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9be9a8e0-a940-4844-8a9f-8280c7ad734c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:48.184859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 857/1704] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:55:47 2022] DELETE /identity/v3/users/779cc2e8f26344a28598f3a3dfb91ea0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:48.186330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d5f16-5f7b-4353-a908-f9c58a9a0e19 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.186623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d5f16-5f7b-4353-a908-f9c58a9a0e19 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.188326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d5f16-5f7b-4353-a908-f9c58a9a0e19 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.190060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 858/1705] 10.222.0.81 () {54 vars in 912 bytes} [Thu Jun 16 14:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:48.199467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2df64-5525-457f-a78e-e5b9175e9eb9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.199467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2df64-5525-457f-a78e-e5b9175e9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.199467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2df64-5525-457f-a78e-e5b9175e9eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.253827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7ae2df64-5525-457f-a78e-e5b9175e9eb9 None None] MFA Rules not processed for user `8940bddd49534f01a8b1bf1dee644216`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:48.255443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7ae2df64-5525-457f-a78e-e5b9175e9eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:48.306114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:48.358443 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9a8e0-a940-4844-8a9f-8280c7ad734c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:48.360523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9a8e0-a940-4844-8a9f-8280c7ad734c service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:48.376989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 848/1706] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 14:55:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 14:55:48.378540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9a8e0-a940-4844-8a9f-8280c7ad734c service swift] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:48.380830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9be9a8e0-a940-4844-8a9f-8280c7ad734c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:48.410362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9a8e0-a940-4844-8a9f-8280c7ad734c service swift] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:48.429073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:48.475903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 859/1707] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:48.534642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2df64-5525-457f-a78e-e5b9175e9eb9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:48.544242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7ae2df64-5525-457f-a78e-e5b9175e9eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:48.574387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:48.575183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.575475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.575758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] PATH_INFO: `/v3/users/411b174063b24c1fbc67fc7fab980e45` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.577301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=411b174063b24c1fbc67fc7fab980e45)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:48.580842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:48.714569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411b174063b24c1fbc67fc7fab980e45'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:48.740586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411b174063b24c1fbc67fc7fab980e45'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:48.794906 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411b174063b24c1fbc67fc7fab980e45'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:48.798794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411b174063b24c1fbc67fc7fab980e45'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:48.821624 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411b174063b24c1fbc67fc7fab980e45'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:48.836965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2df64-5525-457f-a78e-e5b9175e9eb9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:48.843473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 849/1708] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:55:48 2022] DELETE /identity/v3/users/411b174063b24c1fbc67fc7fab980e45 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:48.848166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:48.852858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:49.003740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:49.005281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.005574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.005858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] PATH_INFO: `/v3/projects/ffc63da62c334459a1e0207fe38d25b3` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.007994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc63da62c334459a1e0207fe38d25b3)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:49.040469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:49.094566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d85b1-8390-4c64-aaf2-af5eec4e4e9f admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:49.114802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf304916-bcd2-4e9b-81b8-39e86fa77247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:49.115485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf304916-bcd2-4e9b-81b8-39e86fa77247 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.115772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf304916-bcd2-4e9b-81b8-39e86fa77247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.116420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf304916-bcd2-4e9b-81b8-39e86fa77247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.123701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-bf304916-bcd2-4e9b-81b8-39e86fa77247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:49.164712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf304916-bcd2-4e9b-81b8-39e86fa77247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:49.166294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf304916-bcd2-4e9b-81b8-39e86fa77247 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:49.167392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc63da62c334459a1e0207fe38d25b3', 'request_id': 'req-c30f39b4-b6f5-492a-ae24-22792acacd2d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:49.186127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc63da62c334459a1e0207fe38d25b3', 'request_id': 'req-c30f39b4-b6f5-492a-ae24-22792acacd2d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:49.203028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 850/1709] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:49.203943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc63da62c334459a1e0207fe38d25b3', 'request_id': 'req-c30f39b4-b6f5-492a-ae24-22792acacd2d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:49.204358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a270fc-454d-49d1-af3a-676d84f58c23 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.204654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a270fc-454d-49d1-af3a-676d84f58c23 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.204960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a270fc-454d-49d1-af3a-676d84f58c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.225623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:49.239351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] The token cache is being invalidate because project ffc63da62c334459a1e0207fe38d25b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:55:49.239351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:49.239351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c30f39b4-b6f5-492a-ae24-22792acacd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:49.241066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 860/1710] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:55:48 2022] DELETE /identity/v3/projects/ffc63da62c334459a1e0207fe38d25b3 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:55:49.242238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099617-c1d6-4505-be6e-07ce980809d4 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.242610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099617-c1d6-4505-be6e-07ce980809d4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.242899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099617-c1d6-4505-be6e-07ce980809d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.272854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-29a270fc-454d-49d1-af3a-676d84f58c23 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:49.276765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-29a270fc-454d-49d1-af3a-676d84f58c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:49.294842 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d9099617-c1d6-4505-be6e-07ce980809d4 None None] MFA Rules not processed for user `7efff0603fb7461ca799c67a8050e181`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:49.301329 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d9099617-c1d6-4505-be6e-07ce980809d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:49.361484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:49.479791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 851/1711] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:49.481288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a85308-f176-495d-8c4e-091e3bcbbe79 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.484880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a85308-f176-495d-8c4e-091e3bcbbe79 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.485298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a85308-f176-495d-8c4e-091e3bcbbe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.538039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 861/1712] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:49.538039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9099617-c1d6-4505-be6e-07ce980809d4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:49.539994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d9099617-c1d6-4505-be6e-07ce980809d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:49.552471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d4a85308-f176-495d-8c4e-091e3bcbbe79 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:49.558990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d4a85308-f176-495d-8c4e-091e3bcbbe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:49.611453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 852/1713] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:49.611453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a85308-f176-495d-8c4e-091e3bcbbe79 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:49.614498 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d4a85308-f176-495d-8c4e-091e3bcbbe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:49.699663 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9099617-c1d6-4505-be6e-07ce980809d4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:49.714943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8165e93-3f9e-4ec4-bcc1-edb0a2dd0ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:49.715621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165e93-3f9e-4ec4-bcc1-edb0a2dd0ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.715903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165e93-3f9e-4ec4-bcc1-edb0a2dd0ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.716179 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165e93-3f9e-4ec4-bcc1-edb0a2dd0ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.760352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8165e93-3f9e-4ec4-bcc1-edb0a2dd0ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:49.766972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8165e93-3f9e-4ec4-bcc1-edb0a2dd0ce7 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:49.796051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 862/1714] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:49.797642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee185a2-012d-431d-8358-dbb79105ba83 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.798289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee185a2-012d-431d-8358-dbb79105ba83 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.798289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee185a2-012d-431d-8358-dbb79105ba83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.830969 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fee185a2-012d-431d-8358-dbb79105ba83 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:49.832261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fee185a2-012d-431d-8358-dbb79105ba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:49.857123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a85308-f176-495d-8c4e-091e3bcbbe79 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:49.877298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631168e-2d96-451e-840c-5bb2d0c52cc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:49.880585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631168e-2d96-451e-840c-5bb2d0c52cc4 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.880986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631168e-2d96-451e-840c-5bb2d0c52cc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.882031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631168e-2d96-451e-840c-5bb2d0c52cc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.882505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 863/1715] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:49.886369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee185a2-012d-431d-8358-dbb79105ba83 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:49.911984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631168e-2d96-451e-840c-5bb2d0c52cc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:49.914554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631168e-2d96-451e-840c-5bb2d0c52cc4 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:49.944514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee185a2-012d-431d-8358-dbb79105ba83 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:49.957254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 853/1716] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:49.958245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46483a-47b8-4c1a-b809-9ba9e5b8cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:49.959447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46483a-47b8-4c1a-b809-9ba9e5b8cc73 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.960014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46483a-47b8-4c1a-b809-9ba9e5b8cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.960641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46483a-47b8-4c1a-b809-9ba9e5b8cc73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.964846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46483a-47b8-4c1a-b809-9ba9e5b8cc73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:49.965321 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46483a-47b8-4c1a-b809-9ba9e5b8cc73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:49.969631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46483a-47b8-4c1a-b809-9ba9e5b8cc73 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:50.047545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 864/1717] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:55:50.054108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631168e-2d96-451e-840c-5bb2d0c52cc4 service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:50.077641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631168e-2d96-451e-840c-5bb2d0c52cc4 service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:50.103206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82d1a7-e2b9-4cf7-9e68-998a289575a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:50.103971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82d1a7-e2b9-4cf7-9e68-998a289575a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:50.104340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82d1a7-e2b9-4cf7-9e68-998a289575a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:50.104700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82d1a7-e2b9-4cf7-9e68-998a289575a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:50.105448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82d1a7-e2b9-4cf7-9e68-998a289575a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:50.107478 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82d1a7-e2b9-4cf7-9e68-998a289575a0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:50.172492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278126ee-285a-4365-ab9b-7dd87f184a12 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:50.175525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278126ee-285a-4365-ab9b-7dd87f184a12 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:50.176031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278126ee-285a-4365-ab9b-7dd87f184a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:50.216485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 854/1718] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:50 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:50.219224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82d1a7-e2b9-4cf7-9e68-998a289575a0 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:50.245924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-278126ee-285a-4365-ab9b-7dd87f184a12 None None] MFA Rules not processed for user `561c947ee70e4521b594f0d528e6e6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:50.248648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-278126ee-285a-4365-ab9b-7dd87f184a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:50.485581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82d1a7-e2b9-4cf7-9e68-998a289575a0 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:50.485941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 865/1719] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:50.496911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac703e-a2f4-45e2-8ae0-48f70062ef8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:50.501485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac703e-a2f4-45e2-8ae0-48f70062ef8b admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:50.502416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac703e-a2f4-45e2-8ae0-48f70062ef8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:50.503874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac703e-a2f4-45e2-8ae0-48f70062ef8b admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:50.506568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac703e-a2f4-45e2-8ae0-48f70062ef8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:50.527257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac703e-a2f4-45e2-8ae0-48f70062ef8b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:50.564900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:50.618580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 855/1720] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:50 2022] POST /identity/v3/users => generated 283 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:50.620049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278126ee-285a-4365-ab9b-7dd87f184a12 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:50.655837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278126ee-285a-4365-ab9b-7dd87f184a12 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:50.697584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931723-308d-492a-8e8d-474048e89e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:50.700007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931723-308d-492a-8e8d-474048e89e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:50.701559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931723-308d-492a-8e8d-474048e89e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:50.702038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931723-308d-492a-8e8d-474048e89e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:50.703001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a931723-308d-492a-8e8d-474048e89e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:50.716601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a931723-308d-492a-8e8d-474048e89e4f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:50.763827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 866/1721] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:50.769110 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac703e-a2f4-45e2-8ae0-48f70062ef8b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:50.792776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac703e-a2f4-45e2-8ae0-48f70062ef8b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:50.805258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c0789-7de4-448e-bf6b-e91dda609c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:50.810680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c0789-7de4-448e-bf6b-e91dda609c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:50.811556 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c0789-7de4-448e-bf6b-e91dda609c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:50.812262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c0789-7de4-448e-bf6b-e91dda609c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:50.817642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c0789-7de4-448e-bf6b-e91dda609c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:50.820742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c0789-7de4-448e-bf6b-e91dda609c9d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:50.871702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931723-308d-492a-8e8d-474048e89e4f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:50.895459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931723-308d-492a-8e8d-474048e89e4f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:50.895984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 856/1722] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:50.918492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd1c3c-bf5c-4807-93ba-fb8404d34432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:50.922111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd1c3c-bf5c-4807-93ba-fb8404d34432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:50.922405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd1c3c-bf5c-4807-93ba-fb8404d34432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:50.922687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd1c3c-bf5c-4807-93ba-fb8404d34432 admin admin] PATH_INFO: `/v3/projects/a5f32a77722a45f29152f83e042cbd05/users/fc0ee566646d43d7b3960e84e577e407/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:50.997471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd1c3c-bf5c-4807-93ba-fb8404d34432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f32a77722a45f29152f83e042cbd05, user_id=fc0ee566646d43d7b3960e84e577e407, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:51.000617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd1c3c-bf5c-4807-93ba-fb8404d34432 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:51.056737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 867/1723] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:50 2022] PUT /identity/v3/projects/a5f32a77722a45f29152f83e042cbd05/users/fc0ee566646d43d7b3960e84e577e407/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:51.058941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7790-8828-44b5-a3e9-601625b939a5 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:51.059410 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7790-8828-44b5-a3e9-601625b939a5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:51.059868 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7790-8828-44b5-a3e9-601625b939a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:51.166641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6adc7790-8828-44b5-a3e9-601625b939a5 None None] MFA Rules not processed for user `fc0ee566646d43d7b3960e84e577e407`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:51.168939 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6adc7790-8828-44b5-a3e9-601625b939a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:51.380936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd1c3c-bf5c-4807-93ba-fb8404d34432 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:51.382937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-95fd1c3c-bf5c-4807-93ba-fb8404d34432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:51.429299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:51.464922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 857/1724] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:51.472446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc7790-8828-44b5-a3e9-601625b939a5 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:51.613666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc7790-8828-44b5-a3e9-601625b939a5 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:51.619004 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f4479-7f0e-4886-96fd-2c5e80221019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:51.619762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f4479-7f0e-4886-96fd-2c5e80221019 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:51.620059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f4479-7f0e-4886-96fd-2c5e80221019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:51.620405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f4479-7f0e-4886-96fd-2c5e80221019 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:51.621103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f4479-7f0e-4886-96fd-2c5e80221019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:51.623513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f4479-7f0e-4886-96fd-2c5e80221019 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:51.671664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 858/1725] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:51 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:51.675380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f4479-7f0e-4886-96fd-2c5e80221019 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:51.738131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd1c3c-bf5c-4807-93ba-fb8404d34432 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:51.890591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:51.920778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f4479-7f0e-4886-96fd-2c5e80221019 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:51.933178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b770446-d10b-49a7-a38a-e835f40b70b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:51.934584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b770446-d10b-49a7-a38a-e835f40b70b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:51.934584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b770446-d10b-49a7-a38a-e835f40b70b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:51.934584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b770446-d10b-49a7-a38a-e835f40b70b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:51.935316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b770446-d10b-49a7-a38a-e835f40b70b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:51.943149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b770446-d10b-49a7-a38a-e835f40b70b0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:51.978731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:51.979638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:51.979917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:51.980218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] PATH_INFO: `/v3/projects/54cd2213eb0041319b0d7ab3cf22844f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:51.985163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 859/1726] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:51 2022] POST /identity/v3/users => generated 289 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:55:52.004859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=54cd2213eb0041319b0d7ab3cf22844f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:52.004966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465372-0a64-4322-bec4-ff41fb8f78e5 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:52.004966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465372-0a64-4322-bec4-ff41fb8f78e5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:52.004966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465372-0a64-4322-bec4-ff41fb8f78e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:52.005202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:52.078843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-2d465372-0a64-4322-bec4-ff41fb8f78e5 None None] MFA Rules not processed for user `555dc188a72647f3af56b774d04ab4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:52.084729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2d465372-0a64-4322-bec4-ff41fb8f78e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:52.219251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54cd2213eb0041319b0d7ab3cf22844f', 'request_id': 'req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:52.246937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54cd2213eb0041319b0d7ab3cf22844f', 'request_id': 'req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:52.264031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54cd2213eb0041319b0d7ab3cf22844f', 'request_id': 'req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:52.292295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] The token cache is being invalidate because project 54cd2213eb0041319b0d7ab3cf22844f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:55:52.292583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:52.294556 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:52.296376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 868/1727] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:55:51 2022] DELETE /identity/v3/projects/54cd2213eb0041319b0d7ab3cf22844f => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:55:52.297174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:52.306129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:52.339398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 860/1728] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:52.339398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4601c-0fe4-49d0-aa32-43e4de4456db None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:52.339398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4601c-0fe4-49d0-aa32-43e4de4456db None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:52.339398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4601c-0fe4-49d0-aa32-43e4de4456db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:52.417957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-2ac4601c-0fe4-49d0-aa32-43e4de4456db None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:52.426052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2ac4601c-0fe4-49d0-aa32-43e4de4456db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:52.471831 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:52.580551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48b377-2bf7-4b02-bda3-46cbdae0c93f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:52.606461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4c405-b869-4ec6-8610-b874600d15c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:52.607162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4c405-b869-4ec6-8610-b874600d15c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:52.607445 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4c405-b869-4ec6-8610-b874600d15c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:52.607725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4c405-b869-4ec6-8610-b874600d15c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:52.608467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4c405-b869-4ec6-8610-b874600d15c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:52.623245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4c405-b869-4ec6-8610-b874600d15c5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:52.692426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 861/1729] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:52.697300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 869/1730] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:52.702017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4c405-b869-4ec6-8610-b874600d15c5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:52.702578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3b4e0-8160-4d09-adf8-6bb23297067b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:52.704853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3b4e0-8160-4d09-adf8-6bb23297067b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:52.705358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3b4e0-8160-4d09-adf8-6bb23297067b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:52.750717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4c405-b869-4ec6-8610-b874600d15c5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:52.777777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0133-e8fc-4c35-a6d0-465897918205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:52.779146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0133-e8fc-4c35-a6d0-465897918205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:52.780544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0133-e8fc-4c35-a6d0-465897918205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:52.780984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0133-e8fc-4c35-a6d0-465897918205 admin admin] PATH_INFO: `/v3/projects/02bc953c856e4d3a9cd713e7b84657f2/users/031a735157b24b6aba6c7ffb860461d0/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:52.796826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-22c3b4e0-8160-4d09-adf8-6bb23297067b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:52.803364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-22c3b4e0-8160-4d09-adf8-6bb23297067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:52.828677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 862/1731] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:52.833401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3b4e0-8160-4d09-adf8-6bb23297067b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:52.851330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3b4e0-8160-4d09-adf8-6bb23297067b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:52.866900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cb29f-8698-4ddc-a124-6e1a43f86daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:52.868031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cb29f-8698-4ddc-a124-6e1a43f86daa admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:52.868534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cb29f-8698-4ddc-a124-6e1a43f86daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:52.869112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cb29f-8698-4ddc-a124-6e1a43f86daa admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:52.870661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cb29f-8698-4ddc-a124-6e1a43f86daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:52.872886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cb29f-8698-4ddc-a124-6e1a43f86daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:52.873036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a0133-e8fc-4c35-a6d0-465897918205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02bc953c856e4d3a9cd713e7b84657f2, user_id=031a735157b24b6aba6c7ffb860461d0, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:52.875748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a0133-e8fc-4c35-a6d0-465897918205 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:52.879950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cb29f-8698-4ddc-a124-6e1a43f86daa admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:52.910688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 870/1732] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:52 2022] PUT /identity/v3/projects/02bc953c856e4d3a9cd713e7b84657f2/users/031a735157b24b6aba6c7ffb860461d0/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:52.917978 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0133-e8fc-4c35-a6d0-465897918205 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:52.943769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 863/1733] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:55:52.950501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cb29f-8698-4ddc-a124-6e1a43f86daa admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:52.979976 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cb29f-8698-4ddc-a124-6e1a43f86daa admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:53.100662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0133-e8fc-4c35-a6d0-465897918205 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:53.106274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00140d27-2e1d-45c9-b6fd-de71eecd078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:53.107675 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00140d27-2e1d-45c9-b6fd-de71eecd078f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:53.108275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00140d27-2e1d-45c9-b6fd-de71eecd078f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:53.108782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00140d27-2e1d-45c9-b6fd-de71eecd078f admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:53.109957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00140d27-2e1d-45c9-b6fd-de71eecd078f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:53.113143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00140d27-2e1d-45c9-b6fd-de71eecd078f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:53.130039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 871/1734] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:55:53.134288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00140d27-2e1d-45c9-b6fd-de71eecd078f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:53.153482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00140d27-2e1d-45c9-b6fd-de71eecd078f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:53.174881 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57318-007e-4328-a6fd-b20b8e4f7be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:53.176370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57318-007e-4328-a6fd-b20b8e4f7be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:53.178034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57318-007e-4328-a6fd-b20b8e4f7be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:53.178899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57318-007e-4328-a6fd-b20b8e4f7be1 admin admin] PATH_INFO: `/v3/projects/02bc953c856e4d3a9cd713e7b84657f2/users/031a735157b24b6aba6c7ffb860461d0/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:53.187594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f57318-007e-4328-a6fd-b20b8e4f7be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02bc953c856e4d3a9cd713e7b84657f2, user_id=031a735157b24b6aba6c7ffb860461d0, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:53.192617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f57318-007e-4328-a6fd-b20b8e4f7be1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:53.214078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 872/1735] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:53 2022] PUT /identity/v3/projects/02bc953c856e4d3a9cd713e7b84657f2/users/031a735157b24b6aba6c7ffb860461d0/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:53.228347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f6a7-b316-49b2-9170-1eec8fb05db3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:53.230668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f6a7-b316-49b2-9170-1eec8fb05db3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:53.234296 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f6a7-b316-49b2-9170-1eec8fb05db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:53.271804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181287cc-8ee2-4f75-a8c4-5c26c5dc1932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:53.272864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181287cc-8ee2-4f75-a8c4-5c26c5dc1932 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:53.272864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181287cc-8ee2-4f75-a8c4-5c26c5dc1932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:53.273055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181287cc-8ee2-4f75-a8c4-5c26c5dc1932 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:53.273756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181287cc-8ee2-4f75-a8c4-5c26c5dc1932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:53.276019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181287cc-8ee2-4f75-a8c4-5c26c5dc1932 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:53.304884 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:53.336189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 864/1736] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:52 2022] POST /identity/v3/projects => generated 373 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:55:53.337210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181287cc-8ee2-4f75-a8c4-5c26c5dc1932 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:53.399427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6815f6a7-b316-49b2-9170-1eec8fb05db3 None None] MFA Rules not processed for user `031a735157b24b6aba6c7ffb860461d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:53.403555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6815f6a7-b316-49b2-9170-1eec8fb05db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:53.583705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181287cc-8ee2-4f75-a8c4-5c26c5dc1932 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:53.598929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e66520-373e-4b40-be08-042887208c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:53.602735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66520-373e-4b40-be08-042887208c52 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:53.603334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66520-373e-4b40-be08-042887208c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:53.604362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66520-373e-4b40-be08-042887208c52 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:53.609112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e66520-373e-4b40-be08-042887208c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:53.620965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e66520-373e-4b40-be08-042887208c52 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:53.702354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 865/1737] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:53 2022] POST /identity/v3/users => generated 287 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:53.702354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f396-a77c-4f24-a726-6f0cf1bc3b9a None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:53.702354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f396-a77c-4f24-a726-6f0cf1bc3b9a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:53.703146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f396-a77c-4f24-a726-6f0cf1bc3b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:53.755465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5871f396-a77c-4f24-a726-6f0cf1bc3b9a None None] MFA Rules not processed for user `8940bddd49534f01a8b1bf1dee644216`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:53.760161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5871f396-a77c-4f24-a726-6f0cf1bc3b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:53.940518 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 866/1738] 10.222.0.90 () {58 vars in 1015 bytes} [Thu Jun 16 14:55:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:53.956849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871f396-a77c-4f24-a726-6f0cf1bc3b9a None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:54.002843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871f396-a77c-4f24-a726-6f0cf1bc3b9a None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:54.015937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eb688-649e-4678-aff3-1cd9214d66fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:54.017570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb688-649e-4678-aff3-1cd9214d66fa admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:54.019083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb688-649e-4678-aff3-1cd9214d66fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:54.019782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb688-649e-4678-aff3-1cd9214d66fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:54.022028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394eb688-649e-4678-aff3-1cd9214d66fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:54.024396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394eb688-649e-4678-aff3-1cd9214d66fa admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:54.087655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 867/1739] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:54.093147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eb688-649e-4678-aff3-1cd9214d66fa admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:54.182586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eb688-649e-4678-aff3-1cd9214d66fa admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:54.213575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4493dbb-0726-4e78-8d8b-529b7625af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:54.221270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493dbb-0726-4e78-8d8b-529b7625af32 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:54.221851 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493dbb-0726-4e78-8d8b-529b7625af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:54.222310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493dbb-0726-4e78-8d8b-529b7625af32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:54.229944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4493dbb-0726-4e78-8d8b-529b7625af32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:54.240385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4493dbb-0726-4e78-8d8b-529b7625af32 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:54.311593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 873/1740] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 1087 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:54.316475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815f6a7-b316-49b2-9170-1eec8fb05db3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:54.319628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6815f6a7-b316-49b2-9170-1eec8fb05db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:54.344166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 868/1741] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:54.349573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4493dbb-0726-4e78-8d8b-529b7625af32 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:54.368842 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815f6a7-b316-49b2-9170-1eec8fb05db3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:54.380271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4493dbb-0726-4e78-8d8b-529b7625af32 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:54.390340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168738f3-7ec1-4c55-a7d4-c5b5ffc478ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:54.392330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168738f3-7ec1-4c55-a7d4-c5b5ffc478ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:54.393250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168738f3-7ec1-4c55-a7d4-c5b5ffc478ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:54.393635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168738f3-7ec1-4c55-a7d4-c5b5ffc478ce admin admin] PATH_INFO: `/v3/projects/fb7dcf28d78a48379209f0f237bbe069/users/6a430a3d09c54151a02dcd98cfb4faae/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:54.395285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:54.396301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:54.396590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:54.396866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] PATH_INFO: `/v3/projects/2631270cfaed4db581252080173bf6fa` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:54.399482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2631270cfaed4db581252080173bf6fa)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:54.401479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:54.438939 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168738f3-7ec1-4c55-a7d4-c5b5ffc478ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7dcf28d78a48379209f0f237bbe069, user_id=6a430a3d09c54151a02dcd98cfb4faae, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:54.444748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168738f3-7ec1-4c55-a7d4-c5b5ffc478ce admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:54.484034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 869/1742] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:54 2022] PUT /identity/v3/projects/fb7dcf28d78a48379209f0f237bbe069/users/6a430a3d09c54151a02dcd98cfb4faae/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:54.490697 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168738f3-7ec1-4c55-a7d4-c5b5ffc478ce admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:54.496105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-168738f3-7ec1-4c55-a7d4-c5b5ffc478ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:54.508159 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:54.564052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2631270cfaed4db581252080173bf6fa', 'request_id': 'req-fb9aae73-1248-4324-8c86-cdb0b2b6644f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:54.587994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2631270cfaed4db581252080173bf6fa', 'request_id': 'req-fb9aae73-1248-4324-8c86-cdb0b2b6644f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:54.606090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2631270cfaed4db581252080173bf6fa', 'request_id': 'req-fb9aae73-1248-4324-8c86-cdb0b2b6644f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:54.629588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] The token cache is being invalidate because project 2631270cfaed4db581252080173bf6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:55:54.630122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:54.635425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fb9aae73-1248-4324-8c86-cdb0b2b6644f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:54.641333 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 874/1743] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:55:54 2022] DELETE /identity/v3/projects/2631270cfaed4db581252080173bf6fa => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:54.643279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a11bf-1044-49b2-bd54-da494dd3a908 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:54.643735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a11bf-1044-49b2-bd54-da494dd3a908 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:54.644429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a11bf-1044-49b2-bd54-da494dd3a908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:54.707077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e36a11bf-1044-49b2-bd54-da494dd3a908 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:54.710467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:54.713016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e36a11bf-1044-49b2-bd54-da494dd3a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:54.732524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168738f3-7ec1-4c55-a7d4-c5b5ffc478ce admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:54.874974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 875/1744] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:54.876030 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a11bf-1044-49b2-bd54-da494dd3a908 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:54.883629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e36a11bf-1044-49b2-bd54-da494dd3a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:54.913554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496f16-f551-4fb6-8577-aa9608514ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:54.914418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496f16-f551-4fb6-8577-aa9608514ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:54.915239 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496f16-f551-4fb6-8577-aa9608514ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:54.915239 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496f16-f551-4fb6-8577-aa9608514ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:54.919067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3c496f16-f551-4fb6-8577-aa9608514ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:54.933929 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a11bf-1044-49b2-bd54-da494dd3a908 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:54.963440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:54.964629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:54.965249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:54.973982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] PATH_INFO: `/v3/users/45253411713c4ea0aca0462c52d3e6a5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:54.975881 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45253411713c4ea0aca0462c52d3e6a5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:54.978147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:55.113435 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45253411713c4ea0aca0462c52d3e6a5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:55.114330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45253411713c4ea0aca0462c52d3e6a5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:55.116794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45253411713c4ea0aca0462c52d3e6a5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:55.134066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c496f16-f551-4fb6-8577-aa9608514ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:55.136233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c496f16-f551-4fb6-8577-aa9608514ef1 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:55.146911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45253411713c4ea0aca0462c52d3e6a5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:55.166451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 870/1745] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:55.169560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45253411713c4ea0aca0462c52d3e6a5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:55.171686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496f16-f551-4fb6-8577-aa9608514ef1 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:55.189706 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3c496f16-f551-4fb6-8577-aa9608514ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:55.216450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 876/1746] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:55:54 2022] DELETE /identity/v3/users/45253411713c4ea0aca0462c52d3e6a5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:55.217613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:55.237517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:55.359023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:55.443279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496f16-f551-4fb6-8577-aa9608514ef1 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:55.456861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8caf8-cfc9-4c8e-a576-cf50c069773c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:55.459314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8caf8-cfc9-4c8e-a576-cf50c069773c service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:55.459579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15792a9b-305d-4e73-8bed-d4b6501d4451 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:55.459685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8caf8-cfc9-4c8e-a576-cf50c069773c service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:55.459975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8caf8-cfc9-4c8e-a576-cf50c069773c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:55.464650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-89a8caf8-cfc9-4c8e-a576-cf50c069773c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:55.478396 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e51f18-6788-4163-8e8a-882c3715cb58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:55.479194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e51f18-6788-4163-8e8a-882c3715cb58 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:55.479481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e51f18-6788-4163-8e8a-882c3715cb58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:55.479819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e51f18-6788-4163-8e8a-882c3715cb58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:55.482997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-60e51f18-6788-4163-8e8a-882c3715cb58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:55.508424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8caf8-cfc9-4c8e-a576-cf50c069773c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:55.510926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8caf8-cfc9-4c8e-a576-cf50c069773c service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:55.536669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 871/1747] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:55.537551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8caf8-cfc9-4c8e-a576-cf50c069773c service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:55.541634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-89a8caf8-cfc9-4c8e-a576-cf50c069773c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:55.719441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8caf8-cfc9-4c8e-a576-cf50c069773c service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:55.729083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa69da-3f83-469f-8d79-e1e0bf7af576 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:55.729990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa69da-3f83-469f-8d79-e1e0bf7af576 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:55.730291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa69da-3f83-469f-8d79-e1e0bf7af576 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:55.730571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa69da-3f83-469f-8d79-e1e0bf7af576 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:55.739811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f6aa69da-3f83-469f-8d79-e1e0bf7af576 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:55.769340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:55.870696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e51f18-6788-4163-8e8a-882c3715cb58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:55.876494 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e51f18-6788-4163-8e8a-882c3715cb58 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:55.935063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa69da-3f83-469f-8d79-e1e0bf7af576 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:55.945654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa69da-3f83-469f-8d79-e1e0bf7af576 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:55.949471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 877/1748] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:55.979867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 872/1749] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:57.208364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec454b-5bd3-4635-9038-fde2358e3a94 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:57.208928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec454b-5bd3-4635-9038-fde2358e3a94 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:57.209352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec454b-5bd3-4635-9038-fde2358e3a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:57.304707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-18ec454b-5bd3-4635-9038-fde2358e3a94 None None] MFA Rules not processed for user `765e8ba07bc1465fa3ce3444d05ad36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:57.310144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-18ec454b-5bd3-4635-9038-fde2358e3a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:57.495277 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 878/1750] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:57.607231 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa69da-3f83-469f-8d79-e1e0bf7af576 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:57.609580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f6aa69da-3f83-469f-8d79-e1e0bf7af576 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:57.675386 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa69da-3f83-469f-8d79-e1e0bf7af576 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:57.707204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:57.712537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:57.713067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:57.713569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] PATH_INFO: `/v3/projects/2f5d40c6ec7243f281513884bceef7dd` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:57.728448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5d40c6ec7243f281513884bceef7dd)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:57.732298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:57.951256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5d40c6ec7243f281513884bceef7dd', 'request_id': 'req-f87e1df2-1e55-4241-98b8-a6975b0b572e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:57.967846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5d40c6ec7243f281513884bceef7dd', 'request_id': 'req-f87e1df2-1e55-4241-98b8-a6975b0b572e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:57.990578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5d40c6ec7243f281513884bceef7dd', 'request_id': 'req-f87e1df2-1e55-4241-98b8-a6975b0b572e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:58.056834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] The token cache is being invalidate because project 2f5d40c6ec7243f281513884bceef7dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:55:58.057355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:58.061227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f87e1df2-1e55-4241-98b8-a6975b0b572e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:55:58.066096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 873/1751] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:55:57 2022] DELETE /identity/v3/projects/2f5d40c6ec7243f281513884bceef7dd => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:58.073081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4778a6-4b88-40ec-a5c7-1b804297ea78 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:58.073231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4778a6-4b88-40ec-a5c7-1b804297ea78 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:58.073689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4778a6-4b88-40ec-a5c7-1b804297ea78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:58.131548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9c4778a6-4b88-40ec-a5c7-1b804297ea78 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:58.133806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9c4778a6-4b88-40ec-a5c7-1b804297ea78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:58.386958 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 879/1752] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:58.394097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a42c8-b4c4-4fa0-b55a-fe028de83e04 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:58.395464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a42c8-b4c4-4fa0-b55a-fe028de83e04 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:58.396240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a42c8-b4c4-4fa0-b55a-fe028de83e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:58.445711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a04a42c8-b4c4-4fa0-b55a-fe028de83e04 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:58.447574 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a04a42c8-b4c4-4fa0-b55a-fe028de83e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:58.474883 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 874/1753] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:58.480400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4778a6-4b88-40ec-a5c7-1b804297ea78 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:58.496128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4778a6-4b88-40ec-a5c7-1b804297ea78 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:58.509170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06086ad-c9bc-4c04-8766-1ce20b30397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:58.512360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06086ad-c9bc-4c04-8766-1ce20b30397b admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:58.512969 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06086ad-c9bc-4c04-8766-1ce20b30397b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:58.515635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06086ad-c9bc-4c04-8766-1ce20b30397b admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:58.516702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06086ad-c9bc-4c04-8766-1ce20b30397b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:55:58.518656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06086ad-c9bc-4c04-8766-1ce20b30397b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:58.524625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06086ad-c9bc-4c04-8766-1ce20b30397b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:58.566936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 880/1754] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:55:58.573522 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a42c8-b4c4-4fa0-b55a-fe028de83e04 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:58.603984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a42c8-b4c4-4fa0-b55a-fe028de83e04 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:58.611169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df761474-855b-4778-8a43-4741e790335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:58.613050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761474-855b-4778-8a43-4741e790335c admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:58.613476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761474-855b-4778-8a43-4741e790335c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:58.613900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761474-855b-4778-8a43-4741e790335c admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:58.614803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df761474-855b-4778-8a43-4741e790335c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:58.621640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df761474-855b-4778-8a43-4741e790335c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:58.732167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 875/1755] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:58 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:58.736117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06086ad-c9bc-4c04-8766-1ce20b30397b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:58.752822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06086ad-c9bc-4c04-8766-1ce20b30397b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:58.765504 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:59.002552 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ece5a-2f4f-4638-801d-655129342adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:59.003705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ece5a-2f4f-4638-801d-655129342adb admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:59.003995 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ece5a-2f4f-4638-801d-655129342adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:59.004342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ece5a-2f4f-4638-801d-655129342adb admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:59.005215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ece5a-2f4f-4638-801d-655129342adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:59.007358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ece5a-2f4f-4638-801d-655129342adb admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:59.060440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 881/1756] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:58 2022] POST /identity/v3/users => generated 294 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:59.065313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df761474-855b-4778-8a43-4741e790335c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:59.084505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df761474-855b-4778-8a43-4741e790335c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:59.095419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d923ce-b56a-4dfd-bace-9ddf797c5629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:59.096425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d923ce-b56a-4dfd-bace-9ddf797c5629 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:59.096726 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d923ce-b56a-4dfd-bace-9ddf797c5629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:59.097018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d923ce-b56a-4dfd-bace-9ddf797c5629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:59.097739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d923ce-b56a-4dfd-bace-9ddf797c5629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:59.100266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d923ce-b56a-4dfd-bace-9ddf797c5629 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:59.117387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 876/1757] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:55:59.121083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ece5a-2f4f-4638-801d-655129342adb admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:59.145402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ece5a-2f4f-4638-801d-655129342adb admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:59.151934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c291-d6d6-48aa-bb0b-91fb4cba051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:59.152763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c291-d6d6-48aa-bb0b-91fb4cba051b admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:59.153771 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c291-d6d6-48aa-bb0b-91fb4cba051b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:59.155431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c291-d6d6-48aa-bb0b-91fb4cba051b admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:59.157259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74c291-d6d6-48aa-bb0b-91fb4cba051b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:59.165478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74c291-d6d6-48aa-bb0b-91fb4cba051b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:59.220509 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 882/1758] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:55:59.222477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d923ce-b56a-4dfd-bace-9ddf797c5629 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:59.238870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d923ce-b56a-4dfd-bace-9ddf797c5629 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:59.244333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8403f1-5bb7-4bb4-8f17-0b4bb403fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:59.245271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8403f1-5bb7-4bb4-8f17-0b4bb403fc91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:59.245647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8403f1-5bb7-4bb4-8f17-0b4bb403fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:59.246015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8403f1-5bb7-4bb4-8f17-0b4bb403fc91 admin admin] PATH_INFO: `/v3/projects/6b06d282bfd54aa2a00f2db3049a72ab/users/f0d035a6490c462d991111dd4cde3980/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:59.272893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8403f1-5bb7-4bb4-8f17-0b4bb403fc91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b06d282bfd54aa2a00f2db3049a72ab, user_id=f0d035a6490c462d991111dd4cde3980, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:59.290638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8403f1-5bb7-4bb4-8f17-0b4bb403fc91 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:59.341359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f593b8-6881-4428-b1c9-9cec13025840 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:59.341877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f593b8-6881-4428-b1c9-9cec13025840 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:59.342312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f593b8-6881-4428-b1c9-9cec13025840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:59.355191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 877/1759] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:55:59 2022] PUT /identity/v3/projects/6b06d282bfd54aa2a00f2db3049a72ab/users/f0d035a6490c462d991111dd4cde3980/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:55:59.408603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-34f593b8-6881-4428-b1c9-9cec13025840 None None] MFA Rules not processed for user `f0d035a6490c462d991111dd4cde3980`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:59.409844 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-34f593b8-6881-4428-b1c9-9cec13025840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:59.617420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 883/1760] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:55:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:59.619777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8403f1-5bb7-4bb4-8f17-0b4bb403fc91 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:59.729491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:59.797567 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8403f1-5bb7-4bb4-8f17-0b4bb403fc91 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:59.806456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069294c-bd8e-4ccc-b7c0-b3645b7aa55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:59.806727 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069294c-bd8e-4ccc-b7c0-b3645b7aa55b admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:59.807089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069294c-bd8e-4ccc-b7c0-b3645b7aa55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:59.807339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069294c-bd8e-4ccc-b7c0-b3645b7aa55b admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:59.808097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069294c-bd8e-4ccc-b7c0-b3645b7aa55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:59.810067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069294c-bd8e-4ccc-b7c0-b3645b7aa55b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:59.870971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 878/1761] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:55:59 2022] POST /identity/v3/projects => generated 387 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:55:59.872118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f593b8-6881-4428-b1c9-9cec13025840 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:59.889754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f593b8-6881-4428-b1c9-9cec13025840 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:00.027240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bf966-13b4-4fe0-9bc7-4fe14939fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:00.030237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bf966-13b4-4fe0-9bc7-4fe14939fcbe admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:00.031903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bf966-13b4-4fe0-9bc7-4fe14939fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:00.032360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bf966-13b4-4fe0-9bc7-4fe14939fcbe admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:00.035765 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bf966-13b4-4fe0-9bc7-4fe14939fcbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:00.046778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bf966-13b4-4fe0-9bc7-4fe14939fcbe admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:00.084025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 884/1762] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:55:59 2022] POST /identity/v3/users => generated 300 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:00.085233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069294c-bd8e-4ccc-b7c0-b3645b7aa55b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:00.100831 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069294c-bd8e-4ccc-b7c0-b3645b7aa55b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:00.107773 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442faff-5a62-4756-9294-123df269c2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:00.108908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442faff-5a62-4756-9294-123df269c2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:00.109305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442faff-5a62-4756-9294-123df269c2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:00.110768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442faff-5a62-4756-9294-123df269c2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:00.112272 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442faff-5a62-4756-9294-123df269c2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:00.114767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442faff-5a62-4756-9294-123df269c2e8 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:00.142230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 879/1763] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:00.143919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bf966-13b4-4fe0-9bc7-4fe14939fcbe admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:00.155438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:00.163376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bf966-13b4-4fe0-9bc7-4fe14939fcbe admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:00.175671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe22cc-643f-4a9e-a36f-b97f1ce4901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:00.178699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe22cc-643f-4a9e-a36f-b97f1ce4901f admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:00.180975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe22cc-643f-4a9e-a36f-b97f1ce4901f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:00.182592 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe22cc-643f-4a9e-a36f-b97f1ce4901f admin admin] PATH_INFO: `/v3/projects/3c60db2d6b7543ffa7693d3b971a5dc2/users/6f550102eb0141afbc57a231eec90ff5/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:00.269852 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe22cc-643f-4a9e-a36f-b97f1ce4901f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c60db2d6b7543ffa7693d3b971a5dc2, user_id=6f550102eb0141afbc57a231eec90ff5, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:00.280483 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe22cc-643f-4a9e-a36f-b97f1ce4901f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:00.337720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 885/1764] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:00 2022] PUT /identity/v3/projects/3c60db2d6b7543ffa7693d3b971a5dc2/users/6f550102eb0141afbc57a231eec90ff5/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:00.341297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442faff-5a62-4756-9294-123df269c2e8 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:00.372835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442faff-5a62-4756-9294-123df269c2e8 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:00.455896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800bea0-64da-4823-b778-6135f730a054 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:00.456382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800bea0-64da-4823-b778-6135f730a054 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:00.456596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800bea0-64da-4823-b778-6135f730a054 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:00.459000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 886/1765] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 14:56:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:00.549467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1c113-98f3-4207-8763-713622e07e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:00.555998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1c113-98f3-4207-8763-713622e07e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:00.556758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1c113-98f3-4207-8763-713622e07e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:00.557195 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1c113-98f3-4207-8763-713622e07e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:00.557631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e098-cf68-43c5-9e4f-3d2cc43faca3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:00.557956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e098-cf68-43c5-9e4f-3d2cc43faca3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:00.558254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e098-cf68-43c5-9e4f-3d2cc43faca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:00.559141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1c113-98f3-4207-8763-713622e07e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:00.579017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1c113-98f3-4207-8763-713622e07e96 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:00.612399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c3f5e098-cf68-43c5-9e4f-3d2cc43faca3 None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:00.619624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c3f5e098-cf68-43c5-9e4f-3d2cc43faca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:00.626025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 880/1766] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:00.631166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1c113-98f3-4207-8763-713622e07e96 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:00.663829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1c113-98f3-4207-8763-713622e07e96 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:00.684870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaeb6d-eaea-4ec0-905d-47b82199091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:00.685834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaeb6d-eaea-4ec0-905d-47b82199091b admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:00.691387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaeb6d-eaea-4ec0-905d-47b82199091b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:00.691690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaeb6d-eaea-4ec0-905d-47b82199091b admin admin] PATH_INFO: `/v3/projects/3c60db2d6b7543ffa7693d3b971a5dc2/users/6f550102eb0141afbc57a231eec90ff5/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:00.725899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaeb6d-eaea-4ec0-905d-47b82199091b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c60db2d6b7543ffa7693d3b971a5dc2, user_id=6f550102eb0141afbc57a231eec90ff5, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:00.738693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaeb6d-eaea-4ec0-905d-47b82199091b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:00.795541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 881/1767] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:00 2022] PUT /identity/v3/projects/3c60db2d6b7543ffa7693d3b971a5dc2/users/6f550102eb0141afbc57a231eec90ff5/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:00.802091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97dc09-1669-409a-a642-01ab85f485b3 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:00.802091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97dc09-1669-409a-a642-01ab85f485b3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:00.802091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97dc09-1669-409a-a642-01ab85f485b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:00.906862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-1d97dc09-1669-409a-a642-01ab85f485b3 None None] MFA Rules not processed for user `6f550102eb0141afbc57a231eec90ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:00.908708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1d97dc09-1669-409a-a642-01ab85f485b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:00.922245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 887/1768] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:00.931632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152623e-90e1-4b34-a3da-1251c54740db None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:00.933190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152623e-90e1-4b34-a3da-1251c54740db None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:00.934362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152623e-90e1-4b34-a3da-1251c54740db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:01.001506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6152623e-90e1-4b34-a3da-1251c54740db None None] MFA Rules not processed for user `6a430a3d09c54151a02dcd98cfb4faae`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:01.005443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6152623e-90e1-4b34-a3da-1251c54740db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:01.197356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 882/1769] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:01.201374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198cd81-0820-4c8c-bc49-fc8794d92ac9 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:01.201873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198cd81-0820-4c8c-bc49-fc8794d92ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:01.202182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198cd81-0820-4c8c-bc49-fc8794d92ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:01.227282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 888/1770] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:01.228506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152623e-90e1-4b34-a3da-1251c54740db None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:01.235082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6152623e-90e1-4b34-a3da-1251c54740db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:01.271083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5198cd81-0820-4c8c-bc49-fc8794d92ac9 None None] MFA Rules not processed for user `7efff0603fb7461ca799c67a8050e181`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:01.300521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5198cd81-0820-4c8c-bc49-fc8794d92ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:01.311636 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:01.459912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152623e-90e1-4b34-a3da-1251c54740db None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:01.482602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bd914-5173-4732-ab92-33db49fed1a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:01.485508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bd914-5173-4732-ab92-33db49fed1a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:01.486070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bd914-5173-4732-ab92-33db49fed1a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:01.487200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bd914-5173-4732-ab92-33db49fed1a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:01.521638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bd914-5173-4732-ab92-33db49fed1a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:01.524597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bd914-5173-4732-ab92-33db49fed1a4 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:01.539843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 883/1771] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:01.540525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198cd81-0820-4c8c-bc49-fc8794d92ac9 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:01.547587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5198cd81-0820-4c8c-bc49-fc8794d92ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:01.587552 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 889/1772] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:01.588954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bd914-5173-4732-ab92-33db49fed1a4 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:01.594790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1f8bd914-5173-4732-ab92-33db49fed1a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:01.616114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:01.745680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198cd81-0820-4c8c-bc49-fc8794d92ac9 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:01.754928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4060723-d1ce-48c2-8673-fc0afdaed341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:01.755952 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4060723-d1ce-48c2-8673-fc0afdaed341 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:01.756366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4060723-d1ce-48c2-8673-fc0afdaed341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:01.756751 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4060723-d1ce-48c2-8673-fc0afdaed341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:01.757576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4060723-d1ce-48c2-8673-fc0afdaed341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:01.767319 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4060723-d1ce-48c2-8673-fc0afdaed341 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:01.826602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 884/1773] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:01 2022] POST /identity/v3/projects => generated 373 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:01.833231 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4060723-d1ce-48c2-8673-fc0afdaed341 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:01.866024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bd914-5173-4732-ab92-33db49fed1a4 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:02.022244 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4060723-d1ce-48c2-8673-fc0afdaed341 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:02.032288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f4b2a-9608-4c09-b26d-09822c53a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:02.033517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4b2a-9608-4c09-b26d-09822c53a1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:02.033912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4b2a-9608-4c09-b26d-09822c53a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:02.034313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4b2a-9608-4c09-b26d-09822c53a1ed admin admin] PATH_INFO: `/v3/users/f0d035a6490c462d991111dd4cde3980` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:02.035671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f4b2a-9608-4c09-b26d-09822c53a1ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d035a6490c462d991111dd4cde3980)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:02.038529 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f4b2a-9608-4c09-b26d-09822c53a1ed admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:02.150462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:02.157105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b46f4b2a-9608-4c09-b26d-09822c53a1ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d035a6490c462d991111dd4cde3980'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:02.211943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b46f4b2a-9608-4c09-b26d-09822c53a1ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d035a6490c462d991111dd4cde3980'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:02.280987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e958f65-7373-43f9-b263-f1311e266c88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:02.282047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e958f65-7373-43f9-b263-f1311e266c88 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:02.282463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e958f65-7373-43f9-b263-f1311e266c88 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:02.282909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e958f65-7373-43f9-b263-f1311e266c88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:02.303628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b46f4b2a-9608-4c09-b26d-09822c53a1ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d035a6490c462d991111dd4cde3980'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:02.305544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e958f65-7373-43f9-b263-f1311e266c88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:02.309328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b46f4b2a-9608-4c09-b26d-09822c53a1ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d035a6490c462d991111dd4cde3980'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:02.310480 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e958f65-7373-43f9-b263-f1311e266c88 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:02.343670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 890/1774] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:02.350306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e958f65-7373-43f9-b263-f1311e266c88 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:02.356941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b46f4b2a-9608-4c09-b26d-09822c53a1ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d035a6490c462d991111dd4cde3980'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:02.388417 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 885/1775] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:01 2022] DELETE /identity/v3/users/f0d035a6490c462d991111dd4cde3980 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:02.391901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1c73-881f-4d70-96df-9e568dd1af3c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:02.392236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1c73-881f-4d70-96df-9e568dd1af3c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:02.392632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1c73-881f-4d70-96df-9e568dd1af3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:02.397800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e958f65-7373-43f9-b263-f1311e266c88 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:02.435790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-7a9f1c73-881f-4d70-96df-9e568dd1af3c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:02.440382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7a9f1c73-881f-4d70-96df-9e568dd1af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:02.554443 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 886/1776] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:02.568100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1c73-881f-4d70-96df-9e568dd1af3c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:02.571423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7a9f1c73-881f-4d70-96df-9e568dd1af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:02.609213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351088fb-4c66-4d5e-9f28-ec4781979b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:02.610110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351088fb-4c66-4d5e-9f28-ec4781979b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:02.610551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351088fb-4c66-4d5e-9f28-ec4781979b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:02.610900 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351088fb-4c66-4d5e-9f28-ec4781979b43 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:02.612779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351088fb-4c66-4d5e-9f28-ec4781979b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:02.614976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351088fb-4c66-4d5e-9f28-ec4781979b43 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:02.650894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 891/1777] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:02 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:02.686873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351088fb-4c66-4d5e-9f28-ec4781979b43 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:02.686873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-351088fb-4c66-4d5e-9f28-ec4781979b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:02.716231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351088fb-4c66-4d5e-9f28-ec4781979b43 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:02.731578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0ef85-1d37-4532-91e1-ccfbc77e69fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:02.732597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0ef85-1d37-4532-91e1-ccfbc77e69fc admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:02.733860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0ef85-1d37-4532-91e1-ccfbc77e69fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:02.734293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0ef85-1d37-4532-91e1-ccfbc77e69fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:02.736946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0ef85-1d37-4532-91e1-ccfbc77e69fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:02.740685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0ef85-1d37-4532-91e1-ccfbc77e69fc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:02.774394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 892/1778] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:02.785511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0ef85-1d37-4532-91e1-ccfbc77e69fc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:02.827734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0ef85-1d37-4532-91e1-ccfbc77e69fc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:02.843209 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad6bab-e8a8-4b16-a59e-5c34eece6e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:02.854790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad6bab-e8a8-4b16-a59e-5c34eece6e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:02.855090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad6bab-e8a8-4b16-a59e-5c34eece6e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:02.855377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad6bab-e8a8-4b16-a59e-5c34eece6e40 admin admin] PATH_INFO: `/v3/projects/eb14ad4b40584d4b82c7a4cd7dfa303b/users/a35bf91e9b44479f88ed4d4e40fae923/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:02.856561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1c73-881f-4d70-96df-9e568dd1af3c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:02.863192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:02.897685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079dade-afd0-4707-b084-c90c65690589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:02.898627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079dade-afd0-4707-b084-c90c65690589 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:02.899078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079dade-afd0-4707-b084-c90c65690589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:02.899496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079dade-afd0-4707-b084-c90c65690589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:02.914298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad6bab-e8a8-4b16-a59e-5c34eece6e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb14ad4b40584d4b82c7a4cd7dfa303b, user_id=a35bf91e9b44479f88ed4d4e40fae923, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:02.918749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079dade-afd0-4707-b084-c90c65690589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:02.920458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079dade-afd0-4707-b084-c90c65690589 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:02.930466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad6bab-e8a8-4b16-a59e-5c34eece6e40 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:02.945095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 887/1779] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:03.004647 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 893/1780] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:02 2022] PUT /identity/v3/projects/eb14ad4b40584d4b82c7a4cd7dfa303b/users/a35bf91e9b44479f88ed4d4e40fae923/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:03.006053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079dade-afd0-4707-b084-c90c65690589 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:03.039523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079dade-afd0-4707-b084-c90c65690589 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:03.268240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde40038-6dab-4734-a44f-5fc7061116c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:03.269494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde40038-6dab-4734-a44f-5fc7061116c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:03.270018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde40038-6dab-4734-a44f-5fc7061116c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:03.270504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde40038-6dab-4734-a44f-5fc7061116c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:03.271463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde40038-6dab-4734-a44f-5fc7061116c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:03.276479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde40038-6dab-4734-a44f-5fc7061116c0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:03.290616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:03.306519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 888/1781] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:03.316652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad6bab-e8a8-4b16-a59e-5c34eece6e40 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:03.334372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad6bab-e8a8-4b16-a59e-5c34eece6e40 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:03.340167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b866c-23a7-4646-9886-97273c6db6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:03.341394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b866c-23a7-4646-9886-97273c6db6f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:03.341754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b866c-23a7-4646-9886-97273c6db6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:03.342083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b866c-23a7-4646-9886-97273c6db6f9 admin admin] PATH_INFO: `/v3/projects/eb14ad4b40584d4b82c7a4cd7dfa303b/users/a35bf91e9b44479f88ed4d4e40fae923/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:03.344880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b866c-23a7-4646-9886-97273c6db6f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb14ad4b40584d4b82c7a4cd7dfa303b, user_id=a35bf91e9b44479f88ed4d4e40fae923, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:03.349291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b866c-23a7-4646-9886-97273c6db6f9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:03.370484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 894/1782] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:03 2022] PUT /identity/v3/projects/eb14ad4b40584d4b82c7a4cd7dfa303b/users/a35bf91e9b44479f88ed4d4e40fae923/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:05.085473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde40038-6dab-4734-a44f-5fc7061116c0 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:05.089153 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-cde40038-6dab-4734-a44f-5fc7061116c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:05.110716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde40038-6dab-4734-a44f-5fc7061116c0 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:05.220233 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b866c-23a7-4646-9886-97273c6db6f9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:05.226400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f393b70-f9fb-4df7-a20b-71c13c641145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:05.227366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f393b70-f9fb-4df7-a20b-71c13c641145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:05.227651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f393b70-f9fb-4df7-a20b-71c13c641145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:05.227926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f393b70-f9fb-4df7-a20b-71c13c641145 admin admin] PATH_INFO: `/v3/users/fc0ee566646d43d7b3960e84e577e407` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:05.228196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4c3b866c-23a7-4646-9886-97273c6db6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:05.230355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f393b70-f9fb-4df7-a20b-71c13c641145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0ee566646d43d7b3960e84e577e407)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:05.233978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f393b70-f9fb-4df7-a20b-71c13c641145 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:05.264612 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b866c-23a7-4646-9886-97273c6db6f9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:05.270744 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:05.271826 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:05.272355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:05.272865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] PATH_INFO: `/v3/projects/6b06d282bfd54aa2a00f2db3049a72ab` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:05.281208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b06d282bfd54aa2a00f2db3049a72ab)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:05.285169 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:05.394326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4f393b70-f9fb-4df7-a20b-71c13c641145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0ee566646d43d7b3960e84e577e407'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:05.418576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4f393b70-f9fb-4df7-a20b-71c13c641145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0ee566646d43d7b3960e84e577e407'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:05.447476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4f393b70-f9fb-4df7-a20b-71c13c641145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0ee566646d43d7b3960e84e577e407'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:05.450392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4f393b70-f9fb-4df7-a20b-71c13c641145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0ee566646d43d7b3960e84e577e407'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:05.464075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4f393b70-f9fb-4df7-a20b-71c13c641145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0ee566646d43d7b3960e84e577e407'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:05.477424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 889/1783] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:05 2022] DELETE /identity/v3/users/fc0ee566646d43d7b3960e84e577e407 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:05.479176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beec513-e3b8-4fec-b81b-2e667de2ca3c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:05.479468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beec513-e3b8-4fec-b81b-2e667de2ca3c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:05.479747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beec513-e3b8-4fec-b81b-2e667de2ca3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:05.508907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4beec513-e3b8-4fec-b81b-2e667de2ca3c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:05.511596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4beec513-e3b8-4fec-b81b-2e667de2ca3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:05.525066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b06d282bfd54aa2a00f2db3049a72ab', 'request_id': 'req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:05.561413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b06d282bfd54aa2a00f2db3049a72ab', 'request_id': 'req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:05.580960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b06d282bfd54aa2a00f2db3049a72ab', 'request_id': 'req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:05.597236 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] The token cache is being invalidate because project 6b06d282bfd54aa2a00f2db3049a72ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:05.597535 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:05.600006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b7ae5a56-98b7-4ce9-8853-43fd0c94a6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:05.603582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 895/1784] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:05 2022] DELETE /identity/v3/projects/6b06d282bfd54aa2a00f2db3049a72ab => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:05.606662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57a26-de88-49cd-8403-81bf9c3bf873 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:05.607192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57a26-de88-49cd-8403-81bf9c3bf873 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:05.608140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57a26-de88-49cd-8403-81bf9c3bf873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:05.691502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-55a57a26-de88-49cd-8403-81bf9c3bf873 None None] MFA Rules not processed for user `a35bf91e9b44479f88ed4d4e40fae923`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:05.692923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-55a57a26-de88-49cd-8403-81bf9c3bf873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:05.882634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 896/1785] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:05.883626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57a26-de88-49cd-8403-81bf9c3bf873 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:05.888044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-55a57a26-de88-49cd-8403-81bf9c3bf873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:05.904397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 890/1786] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:05.906066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3a22b-9eba-4e51-94a5-26f763d3c4df None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:05.906447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3a22b-9eba-4e51-94a5-26f763d3c4df None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:05.907186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3a22b-9eba-4e51-94a5-26f763d3c4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:05.937792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-01b3a22b-9eba-4e51-94a5-26f763d3c4df None None] MFA Rules not processed for user `6a430a3d09c54151a02dcd98cfb4faae`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:05.940183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-01b3a22b-9eba-4e51-94a5-26f763d3c4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:05.953103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:05.963067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:05.982350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57a26-de88-49cd-8403-81bf9c3bf873 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:05.989023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:05.990290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:05.990640 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:05.991563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] PATH_INFO: `/v3/users/6f550102eb0141afbc57a231eec90ff5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:05.993284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f550102eb0141afbc57a231eec90ff5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:05.995840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:06.032378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 891/1787] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:06.033971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3a22b-9eba-4e51-94a5-26f763d3c4df None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:06.035683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-01b3a22b-9eba-4e51-94a5-26f763d3c4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:06.082493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f550102eb0141afbc57a231eec90ff5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:06.083390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f550102eb0141afbc57a231eec90ff5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:06.084130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f550102eb0141afbc57a231eec90ff5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:06.092256 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f550102eb0141afbc57a231eec90ff5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:06.106628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f550102eb0141afbc57a231eec90ff5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:06.131398 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 897/1788] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:05 2022] DELETE /identity/v3/users/6f550102eb0141afbc57a231eec90ff5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:06.132371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:06.133996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3a22b-9eba-4e51-94a5-26f763d3c4df None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:06.142685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:06.203762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90126b70-1bd4-43df-9a59-e801191c71f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:06.205270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90126b70-1bd4-43df-9a59-e801191c71f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:06.205641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90126b70-1bd4-43df-9a59-e801191c71f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:06.205872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90126b70-1bd4-43df-9a59-e801191c71f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:06.208221 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-90126b70-1bd4-43df-9a59-e801191c71f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:06.332760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90126b70-1bd4-43df-9a59-e801191c71f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:06.334584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90126b70-1bd4-43df-9a59-e801191c71f3 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:06.346396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 892/1789] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:06.383977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a162e93-c14a-4f8a-9889-971566749b4c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:06.391537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f62c-5dbd-47b2-abb9-f45488e8cbe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:06.392904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f62c-5dbd-47b2-abb9-f45488e8cbe2 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:06.393378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f62c-5dbd-47b2-abb9-f45488e8cbe2 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:06.393652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f62c-5dbd-47b2-abb9-f45488e8cbe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:06.395865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ee86f62c-5dbd-47b2-abb9-f45488e8cbe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:06.480851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:06.488696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86f62c-5dbd-47b2-abb9-f45488e8cbe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:06.490729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86f62c-5dbd-47b2-abb9-f45488e8cbe2 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:06.511605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 898/1790] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:07.502851 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90126b70-1bd4-43df-9a59-e801191c71f3 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:07.504629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-90126b70-1bd4-43df-9a59-e801191c71f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:07.535365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90126b70-1bd4-43df-9a59-e801191c71f3 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:07.556741 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:07.558707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:07.559802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:07.559984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] PATH_INFO: `/v3/projects/a5f32a77722a45f29152f83e042cbd05` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:07.562983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f32a77722a45f29152f83e042cbd05)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:07.566599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:07.611428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:07.640171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f32a77722a45f29152f83e042cbd05', 'request_id': 'req-2feef98a-9f30-411f-8b5b-6dc796ec16ea'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:07.658565 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f32a77722a45f29152f83e042cbd05', 'request_id': 'req-2feef98a-9f30-411f-8b5b-6dc796ec16ea'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:07.670642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f32a77722a45f29152f83e042cbd05', 'request_id': 'req-2feef98a-9f30-411f-8b5b-6dc796ec16ea'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:07.685946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] The token cache is being invalidate because project a5f32a77722a45f29152f83e042cbd05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:07.685946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:07.686701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:07.688582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 893/1791] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:07 2022] DELETE /identity/v3/projects/a5f32a77722a45f29152f83e042cbd05 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:07.692913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f62c-5dbd-47b2-abb9-f45488e8cbe2 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:07.704506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f62c-5dbd-47b2-abb9-f45488e8cbe2 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:07.778891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1422d-37e4-4948-8daa-dd5386e65d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:07.779782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1422d-37e4-4948-8daa-dd5386e65d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:07.780067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1422d-37e4-4948-8daa-dd5386e65d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:07.780345 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1422d-37e4-4948-8daa-dd5386e65d36 admin admin] PATH_INFO: `/v3/users/031a735157b24b6aba6c7ffb860461d0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:07.781547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1422d-37e4-4948-8daa-dd5386e65d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=031a735157b24b6aba6c7ffb860461d0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:07.785185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1422d-37e4-4948-8daa-dd5386e65d36 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:07.825957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:07.829426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:07.846581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feef98a-9f30-411f-8b5b-6dc796ec16ea admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:07.869095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:07.869554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:07.869837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:07.870155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] PATH_INFO: `/v3/projects/3c60db2d6b7543ffa7693d3b971a5dc2` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:07.872427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c60db2d6b7543ffa7693d3b971a5dc2)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:07.874393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:07.904769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-87f1422d-37e4-4948-8daa-dd5386e65d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031a735157b24b6aba6c7ffb860461d0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:07.906198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-87f1422d-37e4-4948-8daa-dd5386e65d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031a735157b24b6aba6c7ffb860461d0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:07.907272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-87f1422d-37e4-4948-8daa-dd5386e65d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031a735157b24b6aba6c7ffb860461d0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:07.922751 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-87f1422d-37e4-4948-8daa-dd5386e65d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031a735157b24b6aba6c7ffb860461d0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:07.933462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-87f1422d-37e4-4948-8daa-dd5386e65d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031a735157b24b6aba6c7ffb860461d0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:07.964780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 899/1792] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:07 2022] DELETE /identity/v3/users/031a735157b24b6aba6c7ffb860461d0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:08.023902 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c60db2d6b7543ffa7693d3b971a5dc2', 'request_id': 'req-3fa38592-61cb-467a-af3f-931df4143faa'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:08.039874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c60db2d6b7543ffa7693d3b971a5dc2', 'request_id': 'req-3fa38592-61cb-467a-af3f-931df4143faa'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:08.049637 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c60db2d6b7543ffa7693d3b971a5dc2', 'request_id': 'req-3fa38592-61cb-467a-af3f-931df4143faa'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:08.065830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] The token cache is being invalidate because project 3c60db2d6b7543ffa7693d3b971a5dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:08.066103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:08.066941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3fa38592-61cb-467a-af3f-931df4143faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:08.069316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 894/1793] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:07 2022] DELETE /identity/v3/projects/3c60db2d6b7543ffa7693d3b971a5dc2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:08.075437 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3c52e-c65c-4b6b-8b66-dc6500b557ff None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:08.075720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3c52e-c65c-4b6b-8b66-dc6500b557ff None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:08.075992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3c52e-c65c-4b6b-8b66-dc6500b557ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:08.101320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c1f3c52e-c65c-4b6b-8b66-dc6500b557ff None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:08.103103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c1f3c52e-c65c-4b6b-8b66-dc6500b557ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:08.250019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956525d-fcee-46ce-9154-44bf8591ab01 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:08.250497 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956525d-fcee-46ce-9154-44bf8591ab01 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:08.250631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956525d-fcee-46ce-9154-44bf8591ab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:08.258084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 900/1794] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:08.284836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-f956525d-fcee-46ce-9154-44bf8591ab01 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:08.286192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f956525d-fcee-46ce-9154-44bf8591ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:08.308386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3c52e-c65c-4b6b-8b66-dc6500b557ff None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:08.315855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 895/1795] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:08.320406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3c52e-c65c-4b6b-8b66-dc6500b557ff None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:08.331629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71014daa-82d1-4928-af7a-c5b451f16cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:08.332401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71014daa-82d1-4928-af7a-c5b451f16cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:08.332753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71014daa-82d1-4928-af7a-c5b451f16cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:08.333093 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71014daa-82d1-4928-af7a-c5b451f16cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:08.334055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71014daa-82d1-4928-af7a-c5b451f16cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:08.334436 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71014daa-82d1-4928-af7a-c5b451f16cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:08.336648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71014daa-82d1-4928-af7a-c5b451f16cfe admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:08.355529 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:08.366104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 901/1796] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:08.371400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956525d-fcee-46ce-9154-44bf8591ab01 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:08.384622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956525d-fcee-46ce-9154-44bf8591ab01 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:08.390008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946b85a-d048-43be-897e-543944b516b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:08.390690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b85a-d048-43be-897e-543944b516b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:08.390976 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b85a-d048-43be-897e-543944b516b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:08.391254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b85a-d048-43be-897e-543944b516b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:08.392233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946b85a-d048-43be-897e-543944b516b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:08.394406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946b85a-d048-43be-897e-543944b516b8 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:08.439547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71014daa-82d1-4928-af7a-c5b451f16cfe admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:08.447776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 896/1797] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:08 2022] POST /identity/v3/projects => generated 401 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:08.457424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71014daa-82d1-4928-af7a-c5b451f16cfe admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:08.651797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c98a79-bde9-48f9-ad07-b154761ed62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:08.652676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c98a79-bde9-48f9-ad07-b154761ed62e admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:08.653104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c98a79-bde9-48f9-ad07-b154761ed62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:08.653529 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c98a79-bde9-48f9-ad07-b154761ed62e admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:08.654397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c98a79-bde9-48f9-ad07-b154761ed62e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:08.664246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c98a79-bde9-48f9-ad07-b154761ed62e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:08.714816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 902/1798] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:08 2022] POST /identity/v3/users => generated 301 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:08.726257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946b85a-d048-43be-897e-543944b516b8 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:08.742171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946b85a-d048-43be-897e-543944b516b8 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:08.755292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086ff58-76c1-4384-94e3-a500ad5af832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:08.755990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ff58-76c1-4384-94e3-a500ad5af832 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:08.756279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ff58-76c1-4384-94e3-a500ad5af832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:08.756560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ff58-76c1-4384-94e3-a500ad5af832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:08.757301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086ff58-76c1-4384-94e3-a500ad5af832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:08.758972 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086ff58-76c1-4384-94e3-a500ad5af832 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:08.794639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 897/1799] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:08.796036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c98a79-bde9-48f9-ad07-b154761ed62e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:08.811216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c98a79-bde9-48f9-ad07-b154761ed62e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:08.821467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d5304-889b-4976-b5e1-8408c4380aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:08.822691 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d5304-889b-4976-b5e1-8408c4380aaa admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:08.823134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d5304-889b-4976-b5e1-8408c4380aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:08.823470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d5304-889b-4976-b5e1-8408c4380aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:08.824358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d5304-889b-4976-b5e1-8408c4380aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:08.826186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d5304-889b-4976-b5e1-8408c4380aaa admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:08.856286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086ff58-76c1-4384-94e3-a500ad5af832 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:08.869386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 903/1800] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:08.873037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086ff58-76c1-4384-94e3-a500ad5af832 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:08.880947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ebf7f-5a58-4642-97d0-e87b5beee85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:08.881871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebf7f-5a58-4642-97d0-e87b5beee85d admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:08.882376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebf7f-5a58-4642-97d0-e87b5beee85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:08.882526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebf7f-5a58-4642-97d0-e87b5beee85d admin admin] PATH_INFO: `/v3/projects/96546b4597754db99613a93a88f19ef0/users/9725bc065c1a438193f837dd37dc6027/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:08.905652 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ebf7f-5a58-4642-97d0-e87b5beee85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96546b4597754db99613a93a88f19ef0, user_id=9725bc065c1a438193f837dd37dc6027, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:08.910638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ebf7f-5a58-4642-97d0-e87b5beee85d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:08.938864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 898/1801] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:08 2022] PUT /identity/v3/projects/96546b4597754db99613a93a88f19ef0/users/9725bc065c1a438193f837dd37dc6027/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:08.951182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54025-c2b1-40df-a0b5-ce2545cdfb30 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:08.951425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54025-c2b1-40df-a0b5-ce2545cdfb30 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:08.951767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54025-c2b1-40df-a0b5-ce2545cdfb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:08.969437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e61648-0725-4c77-84bd-4d1eafba6524 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:08.970927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e61648-0725-4c77-84bd-4d1eafba6524 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:08.971387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e61648-0725-4c77-84bd-4d1eafba6524 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:08.978406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 899/1802] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 14:56:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:08.997447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e61648-0725-4c77-84bd-4d1eafba6524 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:08.999681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-78e61648-0725-4c77-84bd-4d1eafba6524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:09.027577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8ab54025-c2b1-40df-a0b5-ce2545cdfb30 None None] MFA Rules not processed for user `9725bc065c1a438193f837dd37dc6027`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:09.029163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8ab54025-c2b1-40df-a0b5-ce2545cdfb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:09.088853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:09.128229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e61648-0725-4c77-84bd-4d1eafba6524 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:09.166030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:09.166030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.166030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.166030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] PATH_INFO: `/v3/projects/02bc953c856e4d3a9cd713e7b84657f2` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.166907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02bc953c856e4d3a9cd713e7b84657f2)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:09.166907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:09.202052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 904/1803] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:09.205589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c2c2-f810-4e62-8ab2-f893c6bc743e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.205873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c2c2-f810-4e62-8ab2-f893c6bc743e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.207912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c2c2-f810-4e62-8ab2-f893c6bc743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.282607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4eb5c2c2-f810-4e62-8ab2-f893c6bc743e None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:09.285025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4eb5c2c2-f810-4e62-8ab2-f893c6bc743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:09.397211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02bc953c856e4d3a9cd713e7b84657f2', 'request_id': 'req-0f2764c0-079a-4a69-8422-5a443ef6a072'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:09.418986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02bc953c856e4d3a9cd713e7b84657f2', 'request_id': 'req-0f2764c0-079a-4a69-8422-5a443ef6a072'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:09.439147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02bc953c856e4d3a9cd713e7b84657f2', 'request_id': 'req-0f2764c0-079a-4a69-8422-5a443ef6a072'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:09.449732 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:09.456651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] The token cache is being invalidate because project 02bc953c856e4d3a9cd713e7b84657f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:09.457171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:09.458645 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:09.460884 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 900/1804] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:08 2022] DELETE /identity/v3/projects/02bc953c856e4d3a9cd713e7b84657f2 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:09.461457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:09.465852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:09.470291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 905/1805] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:09.472119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e73950-a494-440f-82de-d4e459dcb2d8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.472524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e73950-a494-440f-82de-d4e459dcb2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.472891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e73950-a494-440f-82de-d4e459dcb2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.495526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-90e73950-a494-440f-82de-d4e459dcb2d8 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:09.496817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-90e73950-a494-440f-82de-d4e459dcb2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:09.550419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2764c0-079a-4a69-8422-5a443ef6a072 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:09.555352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b157ca-7f4a-4fdd-a2c8-bcc15b9bcc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:09.556028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b157ca-7f4a-4fdd-a2c8-bcc15b9bcc06 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.556307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b157ca-7f4a-4fdd-a2c8-bcc15b9bcc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.556582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b157ca-7f4a-4fdd-a2c8-bcc15b9bcc06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.557318 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b157ca-7f4a-4fdd-a2c8-bcc15b9bcc06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:09.559289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b157ca-7f4a-4fdd-a2c8-bcc15b9bcc06 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:09.559430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 906/1806] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:09.562756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e73950-a494-440f-82de-d4e459dcb2d8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:09.564119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-90e73950-a494-440f-82de-d4e459dcb2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:09.592209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 901/1807] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:09 2022] POST /identity/v3/projects => generated 399 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:09.592209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d33f-980e-4a71-a2de-c000dbb8c3e7 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.592209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d33f-980e-4a71-a2de-c000dbb8c3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.592209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d33f-980e-4a71-a2de-c000dbb8c3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.612382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-bfb6d33f-980e-4a71-a2de-c000dbb8c3e7 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:09.613075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-bfb6d33f-980e-4a71-a2de-c000dbb8c3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:09.646763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e73950-a494-440f-82de-d4e459dcb2d8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:09.671624 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:09.691750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 902/1808] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:09.692594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6d33f-980e-4a71-a2de-c000dbb8c3e7 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:09.702143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6d33f-980e-4a71-a2de-c000dbb8c3e7 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:09.707426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab449234-8598-48f4-9a0b-76de6c38f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:09.708101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449234-8598-48f4-9a0b-76de6c38f65a admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.708380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449234-8598-48f4-9a0b-76de6c38f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.708664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449234-8598-48f4-9a0b-76de6c38f65a admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.709361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab449234-8598-48f4-9a0b-76de6c38f65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:09.711332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab449234-8598-48f4-9a0b-76de6c38f65a admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:09.724372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10cbe4-4e22-4a42-96ce-952d92bf7cd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:09.725135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10cbe4-4e22-4a42-96ce-952d92bf7cd7 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.725411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10cbe4-4e22-4a42-96ce-952d92bf7cd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.725702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10cbe4-4e22-4a42-96ce-952d92bf7cd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.735852 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10cbe4-4e22-4a42-96ce-952d92bf7cd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:09.736317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 903/1809] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:09 2022] POST /identity/v3/users => generated 306 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:09.737516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab449234-8598-48f4-9a0b-76de6c38f65a admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:09.738739 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10cbe4-4e22-4a42-96ce-952d92bf7cd7 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:09.748185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab449234-8598-48f4-9a0b-76de6c38f65a admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:09.751201 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 907/1810] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:09.752439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10cbe4-4e22-4a42-96ce-952d92bf7cd7 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:09.754059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f846a03-6241-40e0-825d-d07e8d617dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:09.754816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f846a03-6241-40e0-825d-d07e8d617dae admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.755174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f846a03-6241-40e0-825d-d07e8d617dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.755523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f846a03-6241-40e0-825d-d07e8d617dae admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.756330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f846a03-6241-40e0-825d-d07e8d617dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:09.756708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f846a03-6241-40e0-825d-d07e8d617dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:09.758393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f846a03-6241-40e0-825d-d07e8d617dae admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:09.763870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10cbe4-4e22-4a42-96ce-952d92bf7cd7 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:09.769575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c4018-9dc6-44d9-9054-fdc06e8f4283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:09.770420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c4018-9dc6-44d9-9054-fdc06e8f4283 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.770713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c4018-9dc6-44d9-9054-fdc06e8f4283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.770995 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c4018-9dc6-44d9-9054-fdc06e8f4283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.771720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c4018-9dc6-44d9-9054-fdc06e8f4283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:09.773322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c4018-9dc6-44d9-9054-fdc06e8f4283 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:09.773436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 904/1811] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:09.777609 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f846a03-6241-40e0-825d-d07e8d617dae admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:09.793742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 908/1812] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:09.794077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f846a03-6241-40e0-825d-d07e8d617dae admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:09.794976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c4018-9dc6-44d9-9054-fdc06e8f4283 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:09.799324 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef7503-9e27-492c-b526-16a11daeb683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:09.800009 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7503-9e27-492c-b526-16a11daeb683 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.800294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7503-9e27-492c-b526-16a11daeb683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.800568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7503-9e27-492c-b526-16a11daeb683 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.801267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef7503-9e27-492c-b526-16a11daeb683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:09.803407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef7503-9e27-492c-b526-16a11daeb683 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:09.811120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c4018-9dc6-44d9-9054-fdc06e8f4283 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:09.817733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc97eb0-fda8-4dd7-9e3d-2e284f122d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:09.818669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97eb0-fda8-4dd7-9e3d-2e284f122d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.819124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97eb0-fda8-4dd7-9e3d-2e284f122d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.819548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97eb0-fda8-4dd7-9e3d-2e284f122d5e admin admin] PATH_INFO: `/v3/projects/32461868eff8474b97e95407bdb15ed4/users/68f8f30454f84e2a959bc4e54a531c26/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.835972 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 905/1813] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:09 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:09.840083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef7503-9e27-492c-b526-16a11daeb683 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:09.842352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:09.849431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc97eb0-fda8-4dd7-9e3d-2e284f122d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32461868eff8474b97e95407bdb15ed4, user_id=68f8f30454f84e2a959bc4e54a531c26, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:09.852523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc97eb0-fda8-4dd7-9e3d-2e284f122d5e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:09.866361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 909/1814] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:09 2022] PUT /identity/v3/projects/32461868eff8474b97e95407bdb15ed4/users/68f8f30454f84e2a959bc4e54a531c26/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:09.870114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc97eb0-fda8-4dd7-9e3d-2e284f122d5e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:09.911141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef7503-9e27-492c-b526-16a11daeb683 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:09.934648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc97eb0-fda8-4dd7-9e3d-2e284f122d5e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:09.939971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d48dd4-82c1-4f28-a8d0-95e53b0cdc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:09.940756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48dd4-82c1-4f28-a8d0-95e53b0cdc1d admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.941043 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48dd4-82c1-4f28-a8d0-95e53b0cdc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.941320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48dd4-82c1-4f28-a8d0-95e53b0cdc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.942084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d48dd4-82c1-4f28-a8d0-95e53b0cdc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:09.943769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d48dd4-82c1-4f28-a8d0-95e53b0cdc1d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:09.953938 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 910/1815] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:09.958043 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d48dd4-82c1-4f28-a8d0-95e53b0cdc1d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:09.968768 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d48dd4-82c1-4f28-a8d0-95e53b0cdc1d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:09.974588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadb99b-6fcf-4af0-9065-2ef566125c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:09.975433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64200bc8-91dd-417b-90d2-f0bbcefb24bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:09.975551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadb99b-6fcf-4af0-9065-2ef566125c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.975753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadb99b-6fcf-4af0-9065-2ef566125c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.976070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadb99b-6fcf-4af0-9065-2ef566125c39 admin admin] PATH_INFO: `/v3/projects/32461868eff8474b97e95407bdb15ed4/users/68f8f30454f84e2a959bc4e54a531c26/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.976180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200bc8-91dd-417b-90d2-f0bbcefb24bf admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:09.976488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200bc8-91dd-417b-90d2-f0bbcefb24bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:09.976768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200bc8-91dd-417b-90d2-f0bbcefb24bf admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:09.977494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64200bc8-91dd-417b-90d2-f0bbcefb24bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:09.978894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadb99b-6fcf-4af0-9065-2ef566125c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32461868eff8474b97e95407bdb15ed4, user_id=68f8f30454f84e2a959bc4e54a531c26, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:09.979589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64200bc8-91dd-417b-90d2-f0bbcefb24bf admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:09.981519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadb99b-6fcf-4af0-9065-2ef566125c39 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:09.995654 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 911/1816] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:09 2022] PUT /identity/v3/projects/32461868eff8474b97e95407bdb15ed4/users/68f8f30454f84e2a959bc4e54a531c26/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:10.003769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 906/1817] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:09 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:10.007078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc5954-bea1-4ad7-85d6-9a73fd694593 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.007372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc5954-bea1-4ad7-85d6-9a73fd694593 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.007652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc5954-bea1-4ad7-85d6-9a73fd694593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.007960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64200bc8-91dd-417b-90d2-f0bbcefb24bf admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:10.019357 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64200bc8-91dd-417b-90d2-f0bbcefb24bf admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:10.041694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-24cc5954-bea1-4ad7-85d6-9a73fd694593 None None] MFA Rules not processed for user `68f8f30454f84e2a959bc4e54a531c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:10.043530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-24cc5954-bea1-4ad7-85d6-9a73fd694593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:10.056373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:10.087571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b65ddb-5fc1-407d-854f-711315b6ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:10.088555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65ddb-5fc1-407d-854f-711315b6ecbb admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.088555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65ddb-5fc1-407d-854f-711315b6ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.088792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65ddb-5fc1-407d-854f-711315b6ecbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.089620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b65ddb-5fc1-407d-854f-711315b6ecbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:10.091267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b65ddb-5fc1-407d-854f-711315b6ecbb admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:10.102496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 907/1818] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:10.106394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b65ddb-5fc1-407d-854f-711315b6ecbb admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:10.116875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b65ddb-5fc1-407d-854f-711315b6ecbb admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:10.121546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcafe-6446-4ba7-b11a-257083c109fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:10.122247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcafe-6446-4ba7-b11a-257083c109fc admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.122532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcafe-6446-4ba7-b11a-257083c109fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.122813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcafe-6446-4ba7-b11a-257083c109fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.123532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fcafe-6446-4ba7-b11a-257083c109fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:10.125162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fcafe-6446-4ba7-b11a-257083c109fc admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:10.132164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 912/1819] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:10.141531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 908/1820] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:10.142740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc5954-bea1-4ad7-85d6-9a73fd694593 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:10.143377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcafe-6446-4ba7-b11a-257083c109fc admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:10.145081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-713fcafe-6446-4ba7-b11a-257083c109fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:10.153163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc5954-bea1-4ad7-85d6-9a73fd694593 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:10.158407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0edb6a-43bf-4769-84fb-7a145360acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:10.159469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0edb6a-43bf-4769-84fb-7a145360acc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.159770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0edb6a-43bf-4769-84fb-7a145360acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.160072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0edb6a-43bf-4769-84fb-7a145360acc4 admin admin] PATH_INFO: `/v3/projects/248294bb8e4b48d69e65b8093b5b9a8c/users/935dd57228724c4f857077c516fce525/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.175432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0edb6a-43bf-4769-84fb-7a145360acc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248294bb8e4b48d69e65b8093b5b9a8c, user_id=935dd57228724c4f857077c516fce525, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:10.178143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0edb6a-43bf-4769-84fb-7a145360acc4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:10.191873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 913/1821] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:10 2022] PUT /identity/v3/projects/248294bb8e4b48d69e65b8093b5b9a8c/users/935dd57228724c4f857077c516fce525/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:10.202202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f05df-9be6-4c69-9a29-42357b69b88f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.202518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f05df-9be6-4c69-9a29-42357b69b88f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.202819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f05df-9be6-4c69-9a29-42357b69b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.203726 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcafe-6446-4ba7-b11a-257083c109fc admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:10.229438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-aa8f05df-9be6-4c69-9a29-42357b69b88f None None] MFA Rules not processed for user `935dd57228724c4f857077c516fce525`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:10.230699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-aa8f05df-9be6-4c69-9a29-42357b69b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:10.258748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebfef4-4bb5-47ba-a665-ed5b62869d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:10.258954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:10.259861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebfef4-4bb5-47ba-a665-ed5b62869d6f service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.260240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebfef4-4bb5-47ba-a665-ed5b62869d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.260507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebfef4-4bb5-47ba-a665-ed5b62869d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.312117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 914/1822] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:10.317111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f05df-9be6-4c69-9a29-42357b69b88f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:10.343849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebfef4-4bb5-47ba-a665-ed5b62869d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:10.345507 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebfef4-4bb5-47ba-a665-ed5b62869d6f service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:10.356378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 909/1823] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:10.392725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f05df-9be6-4c69-9a29-42357b69b88f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:10.399126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06959c7e-1bbb-4160-b2cb-6adb4bb5c3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:10.399827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06959c7e-1bbb-4160-b2cb-6adb4bb5c3cc admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.400113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06959c7e-1bbb-4160-b2cb-6adb4bb5c3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.400391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06959c7e-1bbb-4160-b2cb-6adb4bb5c3cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.401098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06959c7e-1bbb-4160-b2cb-6adb4bb5c3cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:10.403081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06959c7e-1bbb-4160-b2cb-6adb4bb5c3cc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:10.434860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 915/1824] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:10 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:10.438834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebfef4-4bb5-47ba-a665-ed5b62869d6f service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:10.451326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebfef4-4bb5-47ba-a665-ed5b62869d6f service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:10.451461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06959c7e-1bbb-4160-b2cb-6adb4bb5c3cc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:10.475152 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:10.518518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06959c7e-1bbb-4160-b2cb-6adb4bb5c3cc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:10.523446 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa5bd1-de85-4fa0-8a21-c134ca6c36b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:10.524365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5bd1-de85-4fa0-8a21-c134ca6c36b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.524744 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5bd1-de85-4fa0-8a21-c134ca6c36b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.525092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5bd1-de85-4fa0-8a21-c134ca6c36b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.527325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6cfa5bd1-de85-4fa0-8a21-c134ca6c36b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:10.531473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb42061-e8ae-436e-84ef-fef63f352fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:10.532239 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb42061-e8ae-436e-84ef-fef63f352fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.532601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb42061-e8ae-436e-84ef-fef63f352fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.533462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb42061-e8ae-436e-84ef-fef63f352fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.533898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb42061-e8ae-436e-84ef-fef63f352fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:10.537403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb42061-e8ae-436e-84ef-fef63f352fb0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:10.563457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 910/1825] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:10 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:10.567908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb42061-e8ae-436e-84ef-fef63f352fb0 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:10.578697 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb42061-e8ae-436e-84ef-fef63f352fb0 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:10.584266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1720c-8ec9-4491-ac08-c37bd2315c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:10.584945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1720c-8ec9-4491-ac08-c37bd2315c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.585230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1720c-8ec9-4491-ac08-c37bd2315c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.585502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1720c-8ec9-4491-ac08-c37bd2315c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.586278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1720c-8ec9-4491-ac08-c37bd2315c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:10.587889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1720c-8ec9-4491-ac08-c37bd2315c81 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:10.599040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 911/1826] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:10.604828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1720c-8ec9-4491-ac08-c37bd2315c81 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:10.621264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa5bd1-de85-4fa0-8a21-c134ca6c36b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:10.622766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa5bd1-de85-4fa0-8a21-c134ca6c36b5 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:10.625599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1720c-8ec9-4491-ac08-c37bd2315c81 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:10.631737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85714df9-c839-4f78-baed-decd302eca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:10.632750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85714df9-c839-4f78-baed-decd302eca9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.633131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 916/1827] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:10.633243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85714df9-c839-4f78-baed-decd302eca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.633330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85714df9-c839-4f78-baed-decd302eca9d admin admin] PATH_INFO: `/v3/projects/8396bd2bc1134d01a8e7fb4ab40a62ec/users/5cb2f5fb9bf04667b55f04f9709aecb4/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.650842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85714df9-c839-4f78-baed-decd302eca9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8396bd2bc1134d01a8e7fb4ab40a62ec, user_id=5cb2f5fb9bf04667b55f04f9709aecb4, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:10.653666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85714df9-c839-4f78-baed-decd302eca9d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:10.678968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 912/1828] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:10 2022] PUT /identity/v3/projects/8396bd2bc1134d01a8e7fb4ab40a62ec/users/5cb2f5fb9bf04667b55f04f9709aecb4/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:10.680293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa5bd1-de85-4fa0-8a21-c134ca6c36b5 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:10.686934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:10.699131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa5bd1-de85-4fa0-8a21-c134ca6c36b5 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:10.772626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430e271-5406-46f1-90a3-080feda1a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:10.773311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430e271-5406-46f1-90a3-080feda1a82a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.773597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430e271-5406-46f1-90a3-080feda1a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.773871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430e271-5406-46f1-90a3-080feda1a82a admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.774630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430e271-5406-46f1-90a3-080feda1a82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:10.776227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430e271-5406-46f1-90a3-080feda1a82a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:10.791783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 917/1829] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:10.795779 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85714df9-c839-4f78-baed-decd302eca9d admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:10.807511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85714df9-c839-4f78-baed-decd302eca9d admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:10.812466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b213d0-d2a3-41cf-b59f-30642815e8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:10.813572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b213d0-d2a3-41cf-b59f-30642815e8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.813965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b213d0-d2a3-41cf-b59f-30642815e8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.814341 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b213d0-d2a3-41cf-b59f-30642815e8b2 admin admin] PATH_INFO: `/v3/projects/8396bd2bc1134d01a8e7fb4ab40a62ec/users/5cb2f5fb9bf04667b55f04f9709aecb4/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.817018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b213d0-d2a3-41cf-b59f-30642815e8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8396bd2bc1134d01a8e7fb4ab40a62ec, user_id=5cb2f5fb9bf04667b55f04f9709aecb4, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:10.821376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b213d0-d2a3-41cf-b59f-30642815e8b2 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:10.833446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 913/1830] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:10 2022] PUT /identity/v3/projects/8396bd2bc1134d01a8e7fb4ab40a62ec/users/5cb2f5fb9bf04667b55f04f9709aecb4/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:10.845235 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7828c8c-02a7-44f0-8e22-bcad35baf402 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:10.846265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7828c8c-02a7-44f0-8e22-bcad35baf402 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:10.846582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7828c8c-02a7-44f0-8e22-bcad35baf402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:10.879111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b7828c8c-02a7-44f0-8e22-bcad35baf402 None None] MFA Rules not processed for user `5cb2f5fb9bf04667b55f04f9709aecb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:10.880411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b7828c8c-02a7-44f0-8e22-bcad35baf402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:10.977499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 918/1831] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:10.988984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b213d0-d2a3-41cf-b59f-30642815e8b2 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:11.049802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b213d0-d2a3-41cf-b59f-30642815e8b2 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:11.053459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab911510-9bec-4dfb-a89e-78f4754da42e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:11.054143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911510-9bec-4dfb-a89e-78f4754da42e service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:11.054426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911510-9bec-4dfb-a89e-78f4754da42e service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:11.054701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911510-9bec-4dfb-a89e-78f4754da42e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:11.064899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab911510-9bec-4dfb-a89e-78f4754da42e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:11.066384 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab911510-9bec-4dfb-a89e-78f4754da42e service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:11.076063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 914/1832] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:13.463847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7828c8c-02a7-44f0-8e22-bcad35baf402 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:13.548126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7828c8c-02a7-44f0-8e22-bcad35baf402 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:13.554117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:13.555219 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:13.555560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:13.555835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] PATH_INFO: `/v3/users/935dd57228724c4f857077c516fce525` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:13.557400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935dd57228724c4f857077c516fce525)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:13.559500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:13.626592 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:13.684066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935dd57228724c4f857077c516fce525'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:13.685214 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935dd57228724c4f857077c516fce525'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:13.691292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935dd57228724c4f857077c516fce525'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:13.706361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935dd57228724c4f857077c516fce525'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:13.730944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935dd57228724c4f857077c516fce525'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:13.796500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 919/1833] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:13 2022] DELETE /identity/v3/users/935dd57228724c4f857077c516fce525 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:13.801872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9449d6-ca0b-4a99-afd2-f3653f43551b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:13.802473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9449d6-ca0b-4a99-afd2-f3653f43551b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:13.802759 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9449d6-ca0b-4a99-afd2-f3653f43551b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:13.843136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-9b9449d6-ca0b-4a99-afd2-f3653f43551b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:13.847655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9b9449d6-ca0b-4a99-afd2-f3653f43551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:14.016060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 915/1834] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:14.038647 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:14.041121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:14.139139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f958-438e-426b-9da6-b9909b3f2cd4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:14.144506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e700a10-489e-4797-b754-09d19ec5f941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:14.145374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700a10-489e-4797-b754-09d19ec5f941 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:14.145842 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700a10-489e-4797-b754-09d19ec5f941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:14.146779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700a10-489e-4797-b754-09d19ec5f941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:14.164881 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e700a10-489e-4797-b754-09d19ec5f941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:14.166617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e700a10-489e-4797-b754-09d19ec5f941 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:14.177666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 920/1835] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:15.359946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9449d6-ca0b-4a99-afd2-f3653f43551b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:15.365115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9b9449d6-ca0b-4a99-afd2-f3653f43551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:15.386075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9449d6-ca0b-4a99-afd2-f3653f43551b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:15.392825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648db06e-19c1-4f4d-9761-115888dfc5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:15.394477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db06e-19c1-4f4d-9761-115888dfc5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:15.394977 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db06e-19c1-4f4d-9761-115888dfc5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:15.395460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db06e-19c1-4f4d-9761-115888dfc5b0 admin admin] PATH_INFO: `/v3/users/9725bc065c1a438193f837dd37dc6027` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:15.397855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648db06e-19c1-4f4d-9761-115888dfc5b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9725bc065c1a438193f837dd37dc6027)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:15.401213 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648db06e-19c1-4f4d-9761-115888dfc5b0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:15.405557 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:15.480050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-648db06e-19c1-4f4d-9761-115888dfc5b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9725bc065c1a438193f837dd37dc6027'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:15.490709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-648db06e-19c1-4f4d-9761-115888dfc5b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9725bc065c1a438193f837dd37dc6027'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:15.509758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-648db06e-19c1-4f4d-9761-115888dfc5b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9725bc065c1a438193f837dd37dc6027'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:15.511188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-648db06e-19c1-4f4d-9761-115888dfc5b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9725bc065c1a438193f837dd37dc6027'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:15.521548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-648db06e-19c1-4f4d-9761-115888dfc5b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9725bc065c1a438193f837dd37dc6027'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:15.528984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 916/1836] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:15 2022] DELETE /identity/v3/users/9725bc065c1a438193f837dd37dc6027 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:15.533853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0db39e-00b6-4a4b-96f1-258d4874a8c0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:15.534467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0db39e-00b6-4a4b-96f1-258d4874a8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:15.534467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0db39e-00b6-4a4b-96f1-258d4874a8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:15.558291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5e0db39e-00b6-4a4b-96f1-258d4874a8c0 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:15.571942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5e0db39e-00b6-4a4b-96f1-258d4874a8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:15.713749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956bd16-348e-4e17-bc92-723ebaa5880d None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:15.715104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956bd16-348e-4e17-bc92-723ebaa5880d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:15.715541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956bd16-348e-4e17-bc92-723ebaa5880d None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:15.717485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 917/1837] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 14:56:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:56:15.731401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de388-b11f-4bec-bbd1-e7c66a85c530 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:15.731686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de388-b11f-4bec-bbd1-e7c66a85c530 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:15.731959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de388-b11f-4bec-bbd1-e7c66a85c530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:15.755628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 921/1838] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:15.759923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4d4de388-b11f-4bec-bbd1-e7c66a85c530 None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:15.761297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4d4de388-b11f-4bec-bbd1-e7c66a85c530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:15.787053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0db39e-00b6-4a4b-96f1-258d4874a8c0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:15.788901 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5e0db39e-00b6-4a4b-96f1-258d4874a8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:15.871828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 918/1839] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:15.887342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:15.904483 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0db39e-00b6-4a4b-96f1-258d4874a8c0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:15.912202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb1790-efb1-438f-8cc3-cbb95c697ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:15.912872 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1790-efb1-438f-8cc3-cbb95c697ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:15.913419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1790-efb1-438f-8cc3-cbb95c697ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:15.915422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1790-efb1-438f-8cc3-cbb95c697ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:15.926759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb1790-efb1-438f-8cc3-cbb95c697ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:15.928829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb1790-efb1-438f-8cc3-cbb95c697ee6 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:15.944130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 922/1840] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:15.952140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de388-b11f-4bec-bbd1-e7c66a85c530 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:15.953829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4d4de388-b11f-4bec-bbd1-e7c66a85c530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:15.968833 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de388-b11f-4bec-bbd1-e7c66a85c530 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:15.974423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:15.975299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:15.975582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:15.975853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] PATH_INFO: `/v3/projects/248294bb8e4b48d69e65b8093b5b9a8c` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:15.977531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=248294bb8e4b48d69e65b8093b5b9a8c)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:15.979657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:16.039347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248294bb8e4b48d69e65b8093b5b9a8c', 'request_id': 'req-71f62590-7ce0-4992-a8b4-abf636b48f59'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:16.051068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248294bb8e4b48d69e65b8093b5b9a8c', 'request_id': 'req-71f62590-7ce0-4992-a8b4-abf636b48f59'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:16.062308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248294bb8e4b48d69e65b8093b5b9a8c', 'request_id': 'req-71f62590-7ce0-4992-a8b4-abf636b48f59'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:16.068668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:16.082344 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] The token cache is being invalidate because project 248294bb8e4b48d69e65b8093b5b9a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:16.082984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:16.083951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:16.087532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 919/1841] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:15 2022] DELETE /identity/v3/projects/248294bb8e4b48d69e65b8093b5b9a8c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:16.092338 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb1790-efb1-438f-8cc3-cbb95c697ee6 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:16.111331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb1790-efb1-438f-8cc3-cbb95c697ee6 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:16.246221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:16.247163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:16.247444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:16.247720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] PATH_INFO: `/v3/users/5cb2f5fb9bf04667b55f04f9709aecb4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:16.249213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb2f5fb9bf04667b55f04f9709aecb4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:16.253146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:16.288297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:16.291160 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:16.356274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb2f5fb9bf04667b55f04f9709aecb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:16.358000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb2f5fb9bf04667b55f04f9709aecb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:16.360404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb2f5fb9bf04667b55f04f9709aecb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:16.376171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb2f5fb9bf04667b55f04f9709aecb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:16.409733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb2f5fb9bf04667b55f04f9709aecb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:16.437841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f62590-7ce0-4992-a8b4-abf636b48f59 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:16.445855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55bcc8-966b-4100-9028-41e4e3582435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:16.446581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55bcc8-966b-4100-9028-41e4e3582435 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:16.446864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55bcc8-966b-4100-9028-41e4e3582435 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:16.447262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55bcc8-966b-4100-9028-41e4e3582435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:16.449494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3f55bcc8-966b-4100-9028-41e4e3582435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:16.461150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 923/1842] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:16 2022] DELETE /identity/v3/users/5cb2f5fb9bf04667b55f04f9709aecb4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:16.476803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55bcc8-966b-4100-9028-41e4e3582435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:16.478462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55bcc8-966b-4100-9028-41e4e3582435 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:16.518999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 920/1843] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:17.026597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:17.028102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:17.148917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf980c-d83e-4516-b414-27af8009367a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:17.156950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:17.159418 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.159693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.159975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] PATH_INFO: `/v3/projects/8396bd2bc1134d01a8e7fb4ab40a62ec` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.162210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8396bd2bc1134d01a8e7fb4ab40a62ec)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:17.163247 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:17.182489 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:17.199476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55bcc8-966b-4100-9028-41e4e3582435 service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:17.200960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3f55bcc8-966b-4100-9028-41e4e3582435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:17.225801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55bcc8-966b-4100-9028-41e4e3582435 service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:17.240206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:17.241098 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.241381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.245915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] PATH_INFO: `/v3/projects/96546b4597754db99613a93a88f19ef0` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.250150 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=96546b4597754db99613a93a88f19ef0)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:17.253411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:17.266535 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8396bd2bc1134d01a8e7fb4ab40a62ec', 'request_id': 'req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.284707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8396bd2bc1134d01a8e7fb4ab40a62ec', 'request_id': 'req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.294462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8396bd2bc1134d01a8e7fb4ab40a62ec', 'request_id': 'req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.315946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] The token cache is being invalidate because project 8396bd2bc1134d01a8e7fb4ab40a62ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:17.316246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.317124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c5c7edf-bdd5-46af-a4d1-7e03d159d06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.319336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 924/1844] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:17 2022] DELETE /identity/v3/projects/8396bd2bc1134d01a8e7fb4ab40a62ec => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:17.325136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a0e5-7b2c-4708-983b-8e514e2d7dfb None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.326192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a0e5-7b2c-4708-983b-8e514e2d7dfb None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.326611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a0e5-7b2c-4708-983b-8e514e2d7dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.333158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96546b4597754db99613a93a88f19ef0', 'request_id': 'req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.348025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96546b4597754db99613a93a88f19ef0', 'request_id': 'req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.355985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96546b4597754db99613a93a88f19ef0', 'request_id': 'req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.369971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] The token cache is being invalidate because project 96546b4597754db99613a93a88f19ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:17.370649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.371396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.377747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 921/1845] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:17 2022] DELETE /identity/v3/projects/96546b4597754db99613a93a88f19ef0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:17.378871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:17.386006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1290a0e5-7b2c-4708-983b-8e514e2d7dfb None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:17.388189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1290a0e5-7b2c-4708-983b-8e514e2d7dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:17.392831 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:17.510196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 925/1846] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:17.526246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2091a-5499-4d9b-8fd3-055da6c9a2cf admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:17.526768 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e3b6a-b364-4b92-b68b-e96988d91054 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.526768 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e3b6a-b364-4b92-b68b-e96988d91054 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.526768 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e3b6a-b364-4b92-b68b-e96988d91054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.531696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:17.532905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.533526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.533526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] PATH_INFO: `/v3/users/68f8f30454f84e2a959bc4e54a531c26` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.534664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f8f30454f84e2a959bc4e54a531c26)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:17.536595 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:17.542433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:17.556826 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ea9e3b6a-b364-4b92-b68b-e96988d91054 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:17.558186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ea9e3b6a-b364-4b92-b68b-e96988d91054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:17.568436 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 926/1847] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:17.572922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e3b6a-b364-4b92-b68b-e96988d91054 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:17.584672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e3b6a-b364-4b92-b68b-e96988d91054 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:17.593860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1ef04-decd-442d-b429-26a5157d174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:17.594963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1ef04-decd-442d-b429-26a5157d174e admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.595268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1ef04-decd-442d-b429-26a5157d174e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.595770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1ef04-decd-442d-b429-26a5157d174e admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.596588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1ef04-decd-442d-b429-26a5157d174e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:17.597308 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1ef04-decd-442d-b429-26a5157d174e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:17.599594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1ef04-decd-442d-b429-26a5157d174e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:17.620163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 927/1848] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:17.621104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1ef04-decd-442d-b429-26a5157d174e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:17.624317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f8f30454f84e2a959bc4e54a531c26'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.633064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1ef04-decd-442d-b429-26a5157d174e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:17.634650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f8f30454f84e2a959bc4e54a531c26'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.639437 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dd9a6-dd0b-4ea3-a464-9fa5da0f5a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:17.640057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd9a6-dd0b-4ea3-a464-9fa5da0f5a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.640512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd9a6-dd0b-4ea3-a464-9fa5da0f5a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.640797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd9a6-dd0b-4ea3-a464-9fa5da0f5a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.641497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dd9a6-dd0b-4ea3-a464-9fa5da0f5a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:17.644590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dd9a6-dd0b-4ea3-a464-9fa5da0f5a72 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:17.651645 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f8f30454f84e2a959bc4e54a531c26'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.654264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f8f30454f84e2a959bc4e54a531c26'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.669552 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f8f30454f84e2a959bc4e54a531c26'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:17.678950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 922/1849] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:17 2022] DELETE /identity/v3/users/68f8f30454f84e2a959bc4e54a531c26 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:17.691183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 928/1850] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:17 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:17.699107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:17.700744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:17.795951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa2d69-e613-434d-a4c4-01206e899a52 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:17.875590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835c6b-6a90-4de4-ba0d-54c449e0582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:17.877574 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835c6b-6a90-4de4-ba0d-54c449e0582e admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.877906 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835c6b-6a90-4de4-ba0d-54c449e0582e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.878362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835c6b-6a90-4de4-ba0d-54c449e0582e admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.879304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f835c6b-6a90-4de4-ba0d-54c449e0582e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:17.882524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f835c6b-6a90-4de4-ba0d-54c449e0582e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:17.906602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 923/1851] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:17 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:17.911309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dd9a6-dd0b-4ea3-a464-9fa5da0f5a72 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:17.921770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dd9a6-dd0b-4ea3-a464-9fa5da0f5a72 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:17.928890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6563cf7-c28c-4bc3-b838-7ecef499b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:17.934082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6563cf7-c28c-4bc3-b838-7ecef499b080 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.934425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6563cf7-c28c-4bc3-b838-7ecef499b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.934714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6563cf7-c28c-4bc3-b838-7ecef499b080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.935498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6563cf7-c28c-4bc3-b838-7ecef499b080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:17.937179 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6563cf7-c28c-4bc3-b838-7ecef499b080 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:17.949579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 929/1852] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:17.954431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835c6b-6a90-4de4-ba0d-54c449e0582e admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:17.966861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835c6b-6a90-4de4-ba0d-54c449e0582e admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:17.973133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bded002-5bee-48a8-b254-7aae56332037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:17.973909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded002-5bee-48a8-b254-7aae56332037 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.974311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded002-5bee-48a8-b254-7aae56332037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.974632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded002-5bee-48a8-b254-7aae56332037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.975426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bded002-5bee-48a8-b254-7aae56332037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:17.977591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bded002-5bee-48a8-b254-7aae56332037 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:17.997280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 924/1853] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:18.004659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6563cf7-c28c-4bc3-b838-7ecef499b080 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.013906 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bded002-5bee-48a8-b254-7aae56332037 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.015373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6563cf7-c28c-4bc3-b838-7ecef499b080 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.016259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2bded002-5bee-48a8-b254-7aae56332037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:18.020194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80018fd-8f72-44d7-91a9-85c1562b8e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.021081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80018fd-8f72-44d7-91a9-85c1562b8e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.021490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80018fd-8f72-44d7-91a9-85c1562b8e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.021788 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80018fd-8f72-44d7-91a9-85c1562b8e9d admin admin] PATH_INFO: `/v3/projects/3a3d5d1d2da146ff91dbded374d191dc/users/9f5181ad10ab456cabd9fbf566e5dc28/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.031585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bded002-5bee-48a8-b254-7aae56332037 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.037667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.038573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.038861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.039142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] PATH_INFO: `/v3/projects/32461868eff8474b97e95407bdb15ed4` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.042661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32461868eff8474b97e95407bdb15ed4)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.045301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.049336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:18.073276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80018fd-8f72-44d7-91a9-85c1562b8e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d5d1d2da146ff91dbded374d191dc, user_id=9f5181ad10ab456cabd9fbf566e5dc28, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.077251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80018fd-8f72-44d7-91a9-85c1562b8e9d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.094081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 930/1854] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:18 2022] PUT /identity/v3/projects/3a3d5d1d2da146ff91dbded374d191dc/users/9f5181ad10ab456cabd9fbf566e5dc28/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:18.104387 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694feeda-956b-43ff-8e5a-076b2d286da2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.104835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694feeda-956b-43ff-8e5a-076b2d286da2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.105274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694feeda-956b-43ff-8e5a-076b2d286da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.120709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32461868eff8474b97e95407bdb15ed4', 'request_id': 'req-2c92a80a-3e64-485e-8113-875ade3b6b28'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:18.134310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32461868eff8474b97e95407bdb15ed4', 'request_id': 'req-2c92a80a-3e64-485e-8113-875ade3b6b28'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:18.136450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-694feeda-956b-43ff-8e5a-076b2d286da2 None None] MFA Rules not processed for user `9f5181ad10ab456cabd9fbf566e5dc28`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:18.137696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-694feeda-956b-43ff-8e5a-076b2d286da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:18.149641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:18.163567 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32461868eff8474b97e95407bdb15ed4', 'request_id': 'req-2c92a80a-3e64-485e-8113-875ade3b6b28'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:18.178281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] The token cache is being invalidate because project 32461868eff8474b97e95407bdb15ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:18.178681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:18.179518 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2c92a80a-3e64-485e-8113-875ade3b6b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:18.185226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 925/1855] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:18 2022] DELETE /identity/v3/projects/32461868eff8474b97e95407bdb15ed4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:18.187114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535a191-263e-4efd-96a3-80f823c7928a None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.187543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535a191-263e-4efd-96a3-80f823c7928a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.187939 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535a191-263e-4efd-96a3-80f823c7928a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.214927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4535a191-263e-4efd-96a3-80f823c7928a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:18.216133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4535a191-263e-4efd-96a3-80f823c7928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:18.237265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 931/1856] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:18.242777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694feeda-956b-43ff-8e5a-076b2d286da2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.244929 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-694feeda-956b-43ff-8e5a-076b2d286da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:18.326837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 926/1857] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:18.335078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c887-f99c-4204-8be3-11054a84807c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.335369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c887-f99c-4204-8be3-11054a84807c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.335648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c887-f99c-4204-8be3-11054a84807c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.338505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694feeda-956b-43ff-8e5a-076b2d286da2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.343113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b034bf6-5253-4e76-8cef-eaae2f418f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.344098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034bf6-5253-4e76-8cef-eaae2f418f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.344098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034bf6-5253-4e76-8cef-eaae2f418f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.344391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034bf6-5253-4e76-8cef-eaae2f418f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.345643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b034bf6-5253-4e76-8cef-eaae2f418f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.347715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b034bf6-5253-4e76-8cef-eaae2f418f95 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.369532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3983c887-f99c-4204-8be3-11054a84807c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:18.370884 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3983c887-f99c-4204-8be3-11054a84807c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:18.379810 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 932/1858] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:18 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:18.384740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 927/1859] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:18.384922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b034bf6-5253-4e76-8cef-eaae2f418f95 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.385720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983c887-f99c-4204-8be3-11054a84807c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.397821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983c887-f99c-4204-8be3-11054a84807c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.496036 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0a489-c461-4957-8acf-493263982548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.500392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a489-c461-4957-8acf-493263982548 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.500819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a489-c461-4957-8acf-493263982548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.502532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a489-c461-4957-8acf-493263982548 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.505324 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0a489-c461-4957-8acf-493263982548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:18.505656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0a489-c461-4957-8acf-493263982548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.509800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0a489-c461-4957-8acf-493263982548 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.512627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b034bf6-5253-4e76-8cef-eaae2f418f95 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.530468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 928/1860] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:18.531847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6417f94-d7a4-4086-b529-01157cfccd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.531978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0a489-c461-4957-8acf-493263982548 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.535070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6417f94-d7a4-4086-b529-01157cfccd9e admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.535455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6417f94-d7a4-4086-b529-01157cfccd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.535777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6417f94-d7a4-4086-b529-01157cfccd9e admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.536545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6417f94-d7a4-4086-b529-01157cfccd9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.539277 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6417f94-d7a4-4086-b529-01157cfccd9e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.547189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0a489-c461-4957-8acf-493263982548 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.557637 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c264a4-5ca6-4899-8cfa-bc729d23220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.558537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c264a4-5ca6-4899-8cfa-bc729d23220e admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.558724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c264a4-5ca6-4899-8cfa-bc729d23220e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.559171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c264a4-5ca6-4899-8cfa-bc729d23220e admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.559741 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c264a4-5ca6-4899-8cfa-bc729d23220e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.562483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c264a4-5ca6-4899-8cfa-bc729d23220e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.588419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 933/1861] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:18 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:18.590301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6417f94-d7a4-4086-b529-01157cfccd9e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.604618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:18.609443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6417f94-d7a4-4086-b529-01157cfccd9e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.617376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c4290-e8e0-4a9b-a02a-7181845839dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.620917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c4290-e8e0-4a9b-a02a-7181845839dc admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.621406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c4290-e8e0-4a9b-a02a-7181845839dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.621857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c4290-e8e0-4a9b-a02a-7181845839dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.623001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c4290-e8e0-4a9b-a02a-7181845839dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.624786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c4290-e8e0-4a9b-a02a-7181845839dc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.631619 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 929/1862] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:18 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:18.635719 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c264a4-5ca6-4899-8cfa-bc729d23220e admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.646802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 934/1863] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:18.647967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c4290-e8e0-4a9b-a02a-7181845839dc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.677070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c4290-e8e0-4a9b-a02a-7181845839dc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.691127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:18.741338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c264a4-5ca6-4899-8cfa-bc729d23220e admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.750096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f9d72-9e0c-4ee8-aa4a-dc59effc01ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.750795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f9d72-9e0c-4ee8-aa4a-dc59effc01ef admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.751076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f9d72-9e0c-4ee8-aa4a-dc59effc01ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.751876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f9d72-9e0c-4ee8-aa4a-dc59effc01ef admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.752575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f9d72-9e0c-4ee8-aa4a-dc59effc01ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.754701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f9d72-9e0c-4ee8-aa4a-dc59effc01ef admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.755139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4fe08-129c-4c32-bef0-c3eab6eb63d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.756379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4fe08-129c-4c32-bef0-c3eab6eb63d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.756730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4fe08-129c-4c32-bef0-c3eab6eb63d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.757078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4fe08-129c-4c32-bef0-c3eab6eb63d4 admin admin] PATH_INFO: `/v3/projects/7f895e0d22ad46cd8d85f32b1f18f524/users/4415dff2776444fbbaf8abd3ab5efa73/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.780373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4fe08-129c-4c32-bef0-c3eab6eb63d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f895e0d22ad46cd8d85f32b1f18f524, user_id=4415dff2776444fbbaf8abd3ab5efa73, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.785699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4fe08-129c-4c32-bef0-c3eab6eb63d4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.789485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 930/1864] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:18 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:18.791929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f9d72-9e0c-4ee8-aa4a-dc59effc01ef admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.806888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 935/1865] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:18 2022] PUT /identity/v3/projects/7f895e0d22ad46cd8d85f32b1f18f524/users/4415dff2776444fbbaf8abd3ab5efa73/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:18.810862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f9d72-9e0c-4ee8-aa4a-dc59effc01ef admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.811202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4fe08-129c-4c32-bef0-c3eab6eb63d4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.906088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a87e6-1957-421e-9c2e-800cf547b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.906777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a87e6-1957-421e-9c2e-800cf547b788 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.907056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a87e6-1957-421e-9c2e-800cf547b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.907330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a87e6-1957-421e-9c2e-800cf547b788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.908090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4fe08-129c-4c32-bef0-c3eab6eb63d4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.909343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a87e6-1957-421e-9c2e-800cf547b788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.911145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a87e6-1957-421e-9c2e-800cf547b788 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.914589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7459-264e-44e3-a2f6-395d3b55f3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.915592 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7459-264e-44e3-a2f6-395d3b55f3bb admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.916020 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7459-264e-44e3-a2f6-395d3b55f3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.916443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7459-264e-44e3-a2f6-395d3b55f3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.917316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb7459-264e-44e3-a2f6-395d3b55f3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.920036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb7459-264e-44e3-a2f6-395d3b55f3bb admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.926485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 931/1866] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:18.930940 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a87e6-1957-421e-9c2e-800cf547b788 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.934024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 936/1867] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:18.937866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7459-264e-44e3-a2f6-395d3b55f3bb admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.949344 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a87e6-1957-421e-9c2e-800cf547b788 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.951243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7459-264e-44e3-a2f6-395d3b55f3bb admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.957531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb78a1-7dc4-40b7-b343-e93ad80b5a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.958559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca44c8-221b-49dc-afa1-6b3ccf013640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.959466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb78a1-7dc4-40b7-b343-e93ad80b5a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.959787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb78a1-7dc4-40b7-b343-e93ad80b5a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.962693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb78a1-7dc4-40b7-b343-e93ad80b5a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.962693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb78a1-7dc4-40b7-b343-e93ad80b5a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.963513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb78a1-7dc4-40b7-b343-e93ad80b5a32 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.963966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca44c8-221b-49dc-afa1-6b3ccf013640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.964582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca44c8-221b-49dc-afa1-6b3ccf013640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.965063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca44c8-221b-49dc-afa1-6b3ccf013640 admin admin] PATH_INFO: `/v3/projects/7f895e0d22ad46cd8d85f32b1f18f524/users/4415dff2776444fbbaf8abd3ab5efa73/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.967624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca44c8-221b-49dc-afa1-6b3ccf013640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f895e0d22ad46cd8d85f32b1f18f524, user_id=4415dff2776444fbbaf8abd3ab5efa73, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.971133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca44c8-221b-49dc-afa1-6b3ccf013640 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.982270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 932/1868] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:18.987206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb78a1-7dc4-40b7-b343-e93ad80b5a32 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.987724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 937/1869] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:18 2022] PUT /identity/v3/projects/7f895e0d22ad46cd8d85f32b1f18f524/users/4415dff2776444fbbaf8abd3ab5efa73/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:18.997811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e2b38-5ffa-4ead-a5b1-0437d5c3d8da None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.999574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e2b38-5ffa-4ead-a5b1-0437d5c3d8da None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.999985 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e2b38-5ffa-4ead-a5b1-0437d5c3d8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.014101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb78a1-7dc4-40b7-b343-e93ad80b5a32 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:19.051523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8e9e2b38-5ffa-4ead-a5b1-0437d5c3d8da None None] MFA Rules not processed for user `4415dff2776444fbbaf8abd3ab5efa73`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:19.053377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8e9e2b38-5ffa-4ead-a5b1-0437d5c3d8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:19.086985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a167b3-772b-48c3-bf5f-90293efaaffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:19.089739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a167b3-772b-48c3-bf5f-90293efaaffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.090052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a167b3-772b-48c3-bf5f-90293efaaffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.090500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a167b3-772b-48c3-bf5f-90293efaaffc admin admin] PATH_INFO: `/v3/projects/23c530c86ba4456cbdedc9edd9aa8725/users/b17ac6b0c057407790d0c71fc694ffcb/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.115661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a167b3-772b-48c3-bf5f-90293efaaffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c530c86ba4456cbdedc9edd9aa8725, user_id=b17ac6b0c057407790d0c71fc694ffcb, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:19.119933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a167b3-772b-48c3-bf5f-90293efaaffc admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:19.125314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:19.148156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 933/1870] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:18 2022] PUT /identity/v3/projects/23c530c86ba4456cbdedc9edd9aa8725/users/b17ac6b0c057407790d0c71fc694ffcb/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:19.161068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789e6aa-e492-4e2a-9500-7be997b0ed8b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.161608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789e6aa-e492-4e2a-9500-7be997b0ed8b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.162013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789e6aa-e492-4e2a-9500-7be997b0ed8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.170135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 938/1871] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:19.181872 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e2b38-5ffa-4ead-a5b1-0437d5c3d8da None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:19.185054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8e9e2b38-5ffa-4ead-a5b1-0437d5c3d8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:19.196846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:19.210461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6789e6aa-e492-4e2a-9500-7be997b0ed8b None None] MFA Rules not processed for user `b17ac6b0c057407790d0c71fc694ffcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:19.212644 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6789e6aa-e492-4e2a-9500-7be997b0ed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:19.271636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e2b38-5ffa-4ead-a5b1-0437d5c3d8da None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:19.316513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 934/1872] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:19.321349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789e6aa-e492-4e2a-9500-7be997b0ed8b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:19.364758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e61b2-28f2-4962-89fb-a883f911cfc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:19.365714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e61b2-28f2-4962-89fb-a883f911cfc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.366255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e61b2-28f2-4962-89fb-a883f911cfc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.366513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e61b2-28f2-4962-89fb-a883f911cfc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.453475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789e6aa-e492-4e2a-9500-7be997b0ed8b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:19.470442 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aca3d-4d3f-476b-8082-3fce034cd28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:19.472293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aca3d-4d3f-476b-8082-3fce034cd28d admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.472949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aca3d-4d3f-476b-8082-3fce034cd28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.472949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aca3d-4d3f-476b-8082-3fce034cd28d admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.473479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aca3d-4d3f-476b-8082-3fce034cd28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:19.481675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aca3d-4d3f-476b-8082-3fce034cd28d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:19.515915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e61b2-28f2-4962-89fb-a883f911cfc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:19.518251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e61b2-28f2-4962-89fb-a883f911cfc2 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:19.539542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 935/1873] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:19 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:19.544714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aca3d-4d3f-476b-8082-3fce034cd28d admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:19.560595 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 939/1874] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:19.633660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e61b2-28f2-4962-89fb-a883f911cfc2 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:19.635153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f96e61b2-28f2-4962-89fb-a883f911cfc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:19.653422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e61b2-28f2-4962-89fb-a883f911cfc2 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:19.697602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aca3d-4d3f-476b-8082-3fce034cd28d admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:19.706147 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4754111-3753-4d56-8acc-bf5eb79856b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:19.706339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4754111-3753-4d56-8acc-bf5eb79856b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.706613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4754111-3753-4d56-8acc-bf5eb79856b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.706938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4754111-3753-4d56-8acc-bf5eb79856b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.707536 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4754111-3753-4d56-8acc-bf5eb79856b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:19.710386 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4754111-3753-4d56-8acc-bf5eb79856b0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:19.734144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:19.743757 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 936/1875] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:19 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:19.747514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4754111-3753-4d56-8acc-bf5eb79856b0 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:19.762668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba65050-b9e2-4fc2-9b16-bdf05e3819d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:19.764717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4754111-3753-4d56-8acc-bf5eb79856b0 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:19.765087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65050-b9e2-4fc2-9b16-bdf05e3819d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.765544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65050-b9e2-4fc2-9b16-bdf05e3819d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.766101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65050-b9e2-4fc2-9b16-bdf05e3819d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.771829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6089d7e-76e4-4c4f-b5b7-9cbb20089fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:19.772814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6089d7e-76e4-4c4f-b5b7-9cbb20089fed admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.773201 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6089d7e-76e4-4c4f-b5b7-9cbb20089fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.773605 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6089d7e-76e4-4c4f-b5b7-9cbb20089fed admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.774585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6089d7e-76e4-4c4f-b5b7-9cbb20089fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:19.776840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6089d7e-76e4-4c4f-b5b7-9cbb20089fed admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:19.793647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 937/1876] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:19.795294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6089d7e-76e4-4c4f-b5b7-9cbb20089fed admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:19.813595 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:19.837607 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6089d7e-76e4-4c4f-b5b7-9cbb20089fed admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:19.867115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e24df-2d82-4d69-b430-67600872d80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:19.869278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e24df-2d82-4d69-b430-67600872d80c admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.870847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e24df-2d82-4d69-b430-67600872d80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.872104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e24df-2d82-4d69-b430-67600872d80c admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.874333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e24df-2d82-4d69-b430-67600872d80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:19.878210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e24df-2d82-4d69-b430-67600872d80c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:19.894267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba65050-b9e2-4fc2-9b16-bdf05e3819d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:19.896077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba65050-b9e2-4fc2-9b16-bdf05e3819d3 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:19.903966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 938/1877] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:19.908813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e24df-2d82-4d69-b430-67600872d80c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:19.922826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e24df-2d82-4d69-b430-67600872d80c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:19.928671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 940/1878] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:19.934463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a116626-9ca4-487a-b3f6-894b27ac495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:19.935618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a116626-9ca4-487a-b3f6-894b27ac495e admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.936085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a116626-9ca4-487a-b3f6-894b27ac495e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.936464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a116626-9ca4-487a-b3f6-894b27ac495e admin admin] PATH_INFO: `/v3/projects/7fea8d4a342a4f299da97c34d74edbfa/users/5242bec3d9c94556992bbcc9ebd09090/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.955864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a116626-9ca4-487a-b3f6-894b27ac495e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fea8d4a342a4f299da97c34d74edbfa, user_id=5242bec3d9c94556992bbcc9ebd09090, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:19.958964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a116626-9ca4-487a-b3f6-894b27ac495e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:19.985239 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 939/1879] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:19 2022] PUT /identity/v3/projects/7fea8d4a342a4f299da97c34d74edbfa/users/5242bec3d9c94556992bbcc9ebd09090/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:19.996219 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc70d2-2e50-4de5-924d-0590e9d54b8f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.996771 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc70d2-2e50-4de5-924d-0590e9d54b8f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.997292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc70d2-2e50-4de5-924d-0590e9d54b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:20.049699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-24bc70d2-2e50-4de5-924d-0590e9d54b8f None None] MFA Rules not processed for user `5242bec3d9c94556992bbcc9ebd09090`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:20.051041 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-24bc70d2-2e50-4de5-924d-0590e9d54b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:20.148987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 941/1880] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:20.150800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a116626-9ca4-487a-b3f6-894b27ac495e admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:20.350710 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a116626-9ca4-487a-b3f6-894b27ac495e admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:20.366450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e9243-9aa0-4a68-8552-3d02a7a4b132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:20.368286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e9243-9aa0-4a68-8552-3d02a7a4b132 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:20.369693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e9243-9aa0-4a68-8552-3d02a7a4b132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:20.370087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e9243-9aa0-4a68-8552-3d02a7a4b132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:20.372259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e9243-9aa0-4a68-8552-3d02a7a4b132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:20.377194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e9243-9aa0-4a68-8552-3d02a7a4b132 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:20.450192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 940/1881] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:20 2022] POST /identity/v3/projects => generated 379 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:20.454000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc70d2-2e50-4de5-924d-0590e9d54b8f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:20.471373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc70d2-2e50-4de5-924d-0590e9d54b8f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:20.587803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b740ca7-a95d-4858-bd89-b89ac0c97d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:20.588681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b740ca7-a95d-4858-bd89-b89ac0c97d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:20.588967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b740ca7-a95d-4858-bd89-b89ac0c97d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:20.590049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b740ca7-a95d-4858-bd89-b89ac0c97d83 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:20.590645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b740ca7-a95d-4858-bd89-b89ac0c97d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:20.597727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b740ca7-a95d-4858-bd89-b89ac0c97d83 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:20.643288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 942/1882] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:20 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:20.647559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e9243-9aa0-4a68-8552-3d02a7a4b132 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:20.662170 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e9243-9aa0-4a68-8552-3d02a7a4b132 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:20.671483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524df5a6-4cb3-423e-979f-778f3bd5fc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:20.672182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524df5a6-4cb3-423e-979f-778f3bd5fc9c admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:20.672462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524df5a6-4cb3-423e-979f-778f3bd5fc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:20.672736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524df5a6-4cb3-423e-979f-778f3bd5fc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:20.675730 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524df5a6-4cb3-423e-979f-778f3bd5fc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:20.680780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524df5a6-4cb3-423e-979f-778f3bd5fc9c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:20.701424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 941/1883] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:20.705926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b740ca7-a95d-4858-bd89-b89ac0c97d83 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:20.722586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b740ca7-a95d-4858-bd89-b89ac0c97d83 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:20.727803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28b158-19ae-49d2-b01e-84e330243846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:20.729592 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28b158-19ae-49d2-b01e-84e330243846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:20.730002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28b158-19ae-49d2-b01e-84e330243846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:20.730447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28b158-19ae-49d2-b01e-84e330243846 admin admin] PATH_INFO: `/v3/projects/afa1a8f1e9bb4f489ebf8716b8b457a3/users/112aeea3384a4d3197995d82bf99f2e6/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:20.752542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28b158-19ae-49d2-b01e-84e330243846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa1a8f1e9bb4f489ebf8716b8b457a3, user_id=112aeea3384a4d3197995d82bf99f2e6, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:20.772885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28b158-19ae-49d2-b01e-84e330243846 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:20.789157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 943/1884] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:20 2022] PUT /identity/v3/projects/afa1a8f1e9bb4f489ebf8716b8b457a3/users/112aeea3384a4d3197995d82bf99f2e6/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:20.794269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524df5a6-4cb3-423e-979f-778f3bd5fc9c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:20.807491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524df5a6-4cb3-423e-979f-778f3bd5fc9c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:20.904606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace680fb-adfd-4e95-bfcc-c7693bbec8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:20.905448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace680fb-adfd-4e95-bfcc-c7693bbec8fb admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:20.905921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace680fb-adfd-4e95-bfcc-c7693bbec8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:20.906293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace680fb-adfd-4e95-bfcc-c7693bbec8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:20.907194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace680fb-adfd-4e95-bfcc-c7693bbec8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:20.910069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace680fb-adfd-4e95-bfcc-c7693bbec8fb admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:20.925430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 942/1885] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:20.926846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28b158-19ae-49d2-b01e-84e330243846 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:20.939523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28b158-19ae-49d2-b01e-84e330243846 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:20.946280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a918f-6627-410a-aece-228384c3726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:20.947574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a918f-6627-410a-aece-228384c3726f admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:20.948418 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a918f-6627-410a-aece-228384c3726f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:20.948845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a918f-6627-410a-aece-228384c3726f admin admin] PATH_INFO: `/v3/projects/afa1a8f1e9bb4f489ebf8716b8b457a3/users/112aeea3384a4d3197995d82bf99f2e6/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:20.952607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a918f-6627-410a-aece-228384c3726f admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa1a8f1e9bb4f489ebf8716b8b457a3, user_id=112aeea3384a4d3197995d82bf99f2e6, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:20.956299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a918f-6627-410a-aece-228384c3726f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:20.969868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 944/1886] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:20 2022] PUT /identity/v3/projects/afa1a8f1e9bb4f489ebf8716b8b457a3/users/112aeea3384a4d3197995d82bf99f2e6/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:20.980773 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0176c-7525-459b-9a04-2d578fc7f216 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:20.980916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0176c-7525-459b-9a04-2d578fc7f216 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:20.981118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0176c-7525-459b-9a04-2d578fc7f216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:21.015414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-f0c0176c-7525-459b-9a04-2d578fc7f216 None None] MFA Rules not processed for user `112aeea3384a4d3197995d82bf99f2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:21.018488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f0c0176c-7525-459b-9a04-2d578fc7f216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:21.031981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:21.109944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 943/1887] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:21.121038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a918f-6627-410a-aece-228384c3726f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:21.134261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:21.193001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a918f-6627-410a-aece-228384c3726f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:21.196699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944b41-c49e-4e41-9b31-e43f3b6109c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:21.197357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944b41-c49e-4e41-9b31-e43f3b6109c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:21.197639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944b41-c49e-4e41-9b31-e43f3b6109c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:21.197968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944b41-c49e-4e41-9b31-e43f3b6109c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:21.209712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5944b41-c49e-4e41-9b31-e43f3b6109c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:21.211243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5944b41-c49e-4e41-9b31-e43f3b6109c6 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:21.221470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 945/1888] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:21.263651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0176c-7525-459b-9a04-2d578fc7f216 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:21.275013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0176c-7525-459b-9a04-2d578fc7f216 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:21.280436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f03dd-f12b-4d0f-9ca9-008068d64191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:21.281215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f03dd-f12b-4d0f-9ca9-008068d64191 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:21.281929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f03dd-f12b-4d0f-9ca9-008068d64191 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:21.281929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f03dd-f12b-4d0f-9ca9-008068d64191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:21.364470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f03dd-f12b-4d0f-9ca9-008068d64191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:21.366665 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f03dd-f12b-4d0f-9ca9-008068d64191 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:21.390009 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 944/1889] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:23.933242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944b41-c49e-4e41-9b31-e43f3b6109c6 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.018405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944b41-c49e-4e41-9b31-e43f3b6109c6 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.024909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.025838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.026228 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.026623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] PATH_INFO: `/v3/users/9f5181ad10ab456cabd9fbf566e5dc28` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.028171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5181ad10ab456cabd9fbf566e5dc28)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.038693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.118521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5181ad10ab456cabd9fbf566e5dc28'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:24.119199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5181ad10ab456cabd9fbf566e5dc28'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:24.119825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5181ad10ab456cabd9fbf566e5dc28'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:24.132300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5181ad10ab456cabd9fbf566e5dc28'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:24.148548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5181ad10ab456cabd9fbf566e5dc28'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:24.189925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 946/1890] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:23 2022] DELETE /identity/v3/users/9f5181ad10ab456cabd9fbf566e5dc28 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:24.191360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb20a5-1ec7-42d3-bf86-3f38c8c0b7ea None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.191789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb20a5-1ec7-42d3-bf86-3f38c8c0b7ea None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.191927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb20a5-1ec7-42d3-bf86-3f38c8c0b7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.225517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4bfb20a5-1ec7-42d3-bf86-3f38c8c0b7ea None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:24.227329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4bfb20a5-1ec7-42d3-bf86-3f38c8c0b7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.396209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 945/1891] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:24.424831 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.429615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.460446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb20a5-1ec7-42d3-bf86-3f38c8c0b7ea None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.468064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4bfb20a5-1ec7-42d3-bf86-3f38c8c0b7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.501565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6328bf-5e85-4edd-b249-fc7ec1aa2c76 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.518974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.522692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.524585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.525495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] PATH_INFO: `/v3/users/b17ac6b0c057407790d0c71fc694ffcb` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.529360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17ac6b0c057407790d0c71fc694ffcb)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.534905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.629562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:24.664944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb20a5-1ec7-42d3-bf86-3f38c8c0b7ea None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.673808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:24.673984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17ac6b0c057407790d0c71fc694ffcb'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:24.675103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17ac6b0c057407790d0c71fc694ffcb'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:24.676775 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17ac6b0c057407790d0c71fc694ffcb'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:24.685970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd5f1c-9b81-4bf0-8894-6c70a306113b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.687025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd5f1c-9b81-4bf0-8894-6c70a306113b service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.687690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd5f1c-9b81-4bf0-8894-6c70a306113b service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.688041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd5f1c-9b81-4bf0-8894-6c70a306113b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.695262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-50bd5f1c-9b81-4bf0-8894-6c70a306113b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.703628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17ac6b0c057407790d0c71fc694ffcb'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:24.723724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17ac6b0c057407790d0c71fc694ffcb'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:24.732668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd5f1c-9b81-4bf0-8894-6c70a306113b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.737185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd5f1c-9b81-4bf0-8894-6c70a306113b service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.763143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 946/1892] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:24.773499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 947/1893] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:24 2022] DELETE /identity/v3/users/b17ac6b0c057407790d0c71fc694ffcb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:24.779426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8dbcc-963b-40ee-a565-9fb95be05c93 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.779426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8dbcc-963b-40ee-a565-9fb95be05c93 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.779811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8dbcc-963b-40ee-a565-9fb95be05c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.806452 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-86d8dbcc-963b-40ee-a565-9fb95be05c93 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:24.807740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-86d8dbcc-963b-40ee-a565-9fb95be05c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.898043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 947/1894] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:24.931735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.935561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:25.020190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22234fb-e92e-4383-9dc5-857fc411623c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.024872 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92909a-687c-4183-b341-1f042d65220b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.025688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92909a-687c-4183-b341-1f042d65220b service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.025819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92909a-687c-4183-b341-1f042d65220b service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.026891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92909a-687c-4183-b341-1f042d65220b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.038032 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92909a-687c-4183-b341-1f042d65220b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.039402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92909a-687c-4183-b341-1f042d65220b service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.053183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 948/1895] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:25.440412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8dbcc-963b-40ee-a565-9fb95be05c93 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.442443 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-86d8dbcc-963b-40ee-a565-9fb95be05c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:25.467979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8dbcc-963b-40ee-a565-9fb95be05c93 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.485755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.486799 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.488318 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.490414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] PATH_INFO: `/v3/projects/3a3d5d1d2da146ff91dbded374d191dc` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.493570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3d5d1d2da146ff91dbded374d191dc)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.495858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.574871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3d5d1d2da146ff91dbded374d191dc', 'request_id': 'req-35a7d378-e5c3-4ad5-883c-cc81048f4043'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:25.587772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3d5d1d2da146ff91dbded374d191dc', 'request_id': 'req-35a7d378-e5c3-4ad5-883c-cc81048f4043'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:25.599675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3d5d1d2da146ff91dbded374d191dc', 'request_id': 'req-35a7d378-e5c3-4ad5-883c-cc81048f4043'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:25.614204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] The token cache is being invalidate because project 3a3d5d1d2da146ff91dbded374d191dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:25.615153 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:25.616072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:25.619098 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 948/1896] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:25 2022] DELETE /identity/v3/projects/3a3d5d1d2da146ff91dbded374d191dc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:25.623353 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92909a-687c-4183-b341-1f042d65220b service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.633942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92909a-687c-4183-b341-1f042d65220b service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.713660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.714291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.714650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.715146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] PATH_INFO: `/v3/users/4415dff2776444fbbaf8abd3ab5efa73` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.716870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4415dff2776444fbbaf8abd3ab5efa73)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.718988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.780661 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4415dff2776444fbbaf8abd3ab5efa73'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:25.781431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4415dff2776444fbbaf8abd3ab5efa73'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:25.782110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4415dff2776444fbbaf8abd3ab5efa73'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:25.787228 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:25.795793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4415dff2776444fbbaf8abd3ab5efa73'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:25.818825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4415dff2776444fbbaf8abd3ab5efa73'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:25.877901 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 949/1897] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:25 2022] DELETE /identity/v3/users/4415dff2776444fbbaf8abd3ab5efa73 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:26.057812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.059957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.088104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7d378-e5c3-4ad5-883c-cc81048f4043 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.235102 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.236453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.236971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.237244 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] PATH_INFO: `/v3/projects/23c530c86ba4456cbdedc9edd9aa8725` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.242436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c530c86ba4456cbdedc9edd9aa8725)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.248086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.287635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:26.334792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c530c86ba4456cbdedc9edd9aa8725', 'request_id': 'req-44d2126d-bd80-4259-b41b-ea3e58d22e64'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.346942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c530c86ba4456cbdedc9edd9aa8725', 'request_id': 'req-44d2126d-bd80-4259-b41b-ea3e58d22e64'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.356351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c530c86ba4456cbdedc9edd9aa8725', 'request_id': 'req-44d2126d-bd80-4259-b41b-ea3e58d22e64'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.371900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] The token cache is being invalidate because project 23c530c86ba4456cbdedc9edd9aa8725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:26.372218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.373663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.376431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 949/1898] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:26 2022] DELETE /identity/v3/projects/23c530c86ba4456cbdedc9edd9aa8725 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:26.380503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.383018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.405126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf39d68-a419-44b1-9530-15c2408a872d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.529407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1302c48-61c5-427a-a536-c45acdc2979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.530396 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1302c48-61c5-427a-a536-c45acdc2979e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.530681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1302c48-61c5-427a-a536-c45acdc2979e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.530961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1302c48-61c5-427a-a536-c45acdc2979e admin admin] PATH_INFO: `/v3/users/5242bec3d9c94556992bbcc9ebd09090` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.532368 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1302c48-61c5-427a-a536-c45acdc2979e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5242bec3d9c94556992bbcc9ebd09090)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.534701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1302c48-61c5-427a-a536-c45acdc2979e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.570480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.574131 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.604611 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2126d-bd80-4259-b41b-ea3e58d22e64 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.610743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.611663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.612180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.612480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] PATH_INFO: `/v3/projects/7f895e0d22ad46cd8d85f32b1f18f524` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.614042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f895e0d22ad46cd8d85f32b1f18f524)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.616264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.632242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b1302c48-61c5-427a-a536-c45acdc2979e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5242bec3d9c94556992bbcc9ebd09090'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.633908 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b1302c48-61c5-427a-a536-c45acdc2979e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5242bec3d9c94556992bbcc9ebd09090'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.635010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b1302c48-61c5-427a-a536-c45acdc2979e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5242bec3d9c94556992bbcc9ebd09090'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.646657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b1302c48-61c5-427a-a536-c45acdc2979e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5242bec3d9c94556992bbcc9ebd09090'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.658393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b1302c48-61c5-427a-a536-c45acdc2979e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5242bec3d9c94556992bbcc9ebd09090'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.684901 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 950/1899] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:26 2022] DELETE /identity/v3/users/5242bec3d9c94556992bbcc9ebd09090 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:26.691898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f895e0d22ad46cd8d85f32b1f18f524', 'request_id': 'req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.704485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f895e0d22ad46cd8d85f32b1f18f524', 'request_id': 'req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.722786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f895e0d22ad46cd8d85f32b1f18f524', 'request_id': 'req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.737463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] The token cache is being invalidate because project 7f895e0d22ad46cd8d85f32b1f18f524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:26.738141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.739268 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b4f0de4-0555-40bb-aafc-98d9b8c94a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:26.741762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 950/1900] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:26 2022] DELETE /identity/v3/projects/7f895e0d22ad46cd8d85f32b1f18f524 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:26.746596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551a263-19ba-4cee-823d-f553401cd78e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.746885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551a263-19ba-4cee-823d-f553401cd78e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.747162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551a263-19ba-4cee-823d-f553401cd78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.772862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4551a263-19ba-4cee-823d-f553401cd78e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:26.776409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4551a263-19ba-4cee-823d-f553401cd78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.823019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:26.849413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 951/1901] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:26.857634 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52abf3-b318-4638-9f6a-9066555a6c0a None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.857969 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52abf3-b318-4638-9f6a-9066555a6c0a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.859410 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52abf3-b318-4638-9f6a-9066555a6c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.896653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-cc52abf3-b318-4638-9f6a-9066555a6c0a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:26.896653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-cc52abf3-b318-4638-9f6a-9066555a6c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.909794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 951/1902] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:26.915683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551a263-19ba-4cee-823d-f553401cd78e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.928521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551a263-19ba-4cee-823d-f553401cd78e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.934203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdf4d6-4b29-4d78-96b6-57a4df95c164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.934618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf4d6-4b29-4d78-96b6-57a4df95c164 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.934903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf4d6-4b29-4d78-96b6-57a4df95c164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.935174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf4d6-4b29-4d78-96b6-57a4df95c164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.935910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdf4d6-4b29-4d78-96b6-57a4df95c164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:26.936216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdf4d6-4b29-4d78-96b6-57a4df95c164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.937826 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdf4d6-4b29-4d78-96b6-57a4df95c164 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.954858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 952/1903] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:26.955733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52abf3-b318-4638-9f6a-9066555a6c0a None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.965684 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52abf3-b318-4638-9f6a-9066555a6c0a None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.971534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71edea-10ed-41b7-942b-5d370a0bd645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.971987 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71edea-10ed-41b7-942b-5d370a0bd645 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.972275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71edea-10ed-41b7-942b-5d370a0bd645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.972543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71edea-10ed-41b7-942b-5d370a0bd645 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.973245 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71edea-10ed-41b7-942b-5d370a0bd645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.975172 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71edea-10ed-41b7-942b-5d370a0bd645 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.010963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 952/1904] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:27.012039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdf4d6-4b29-4d78-96b6-57a4df95c164 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.029058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdf4d6-4b29-4d78-96b6-57a4df95c164 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.054492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71edea-10ed-41b7-942b-5d370a0bd645 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.056847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2c71edea-10ed-41b7-942b-5d370a0bd645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:27.096936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c4fb-64d3-4b6a-a0a3-9d2978b0678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.097724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c4fb-64d3-4b6a-a0a3-9d2978b0678c admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.098406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c4fb-64d3-4b6a-a0a3-9d2978b0678c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.098406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c4fb-64d3-4b6a-a0a3-9d2978b0678c admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.099102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9c4fb-64d3-4b6a-a0a3-9d2978b0678c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.101059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9c4fb-64d3-4b6a-a0a3-9d2978b0678c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.123818 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 953/1905] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:27 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:27.128647 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c4fb-64d3-4b6a-a0a3-9d2978b0678c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.139892 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c4fb-64d3-4b6a-a0a3-9d2978b0678c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.141162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71edea-10ed-41b7-942b-5d370a0bd645 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.145343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e74d3-ce9a-4bb8-908d-01afe6549fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.146012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.146186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e74d3-ce9a-4bb8-908d-01afe6549fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.146348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e74d3-ce9a-4bb8-908d-01afe6549fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.146599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e74d3-ce9a-4bb8-908d-01afe6549fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.146876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.147172 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.147359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e74d3-ce9a-4bb8-908d-01afe6549fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.147508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] PATH_INFO: `/v3/projects/7fea8d4a342a4f299da97c34d74edbfa` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.148850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fea8d4a342a4f299da97c34d74edbfa)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.149013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e74d3-ce9a-4bb8-908d-01afe6549fb1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.150582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.152209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:27.160316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 954/1906] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:27.164029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e74d3-ce9a-4bb8-908d-01afe6549fb1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.175054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e74d3-ce9a-4bb8-908d-01afe6549fb1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.179865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282bb92-6e7e-4f11-b442-b862d351b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.180517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282bb92-6e7e-4f11-b442-b862d351b965 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.180798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282bb92-6e7e-4f11-b442-b862d351b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.181102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282bb92-6e7e-4f11-b442-b862d351b965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.181830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282bb92-6e7e-4f11-b442-b862d351b965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.183467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282bb92-6e7e-4f11-b442-b862d351b965 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.201534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 955/1907] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:27.206279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282bb92-6e7e-4f11-b442-b862d351b965 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.212264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fea8d4a342a4f299da97c34d74edbfa', 'request_id': 'req-de375d68-dcfb-466c-ab47-90843013fb9b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:27.216391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282bb92-6e7e-4f11-b442-b862d351b965 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.221012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fea8d4a342a4f299da97c34d74edbfa', 'request_id': 'req-de375d68-dcfb-466c-ab47-90843013fb9b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:27.227526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fea8d4a342a4f299da97c34d74edbfa', 'request_id': 'req-de375d68-dcfb-466c-ab47-90843013fb9b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:27.244981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] The token cache is being invalidate because project 7fea8d4a342a4f299da97c34d74edbfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:27.245570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:27.246756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:27.248615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 953/1908] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:27 2022] DELETE /identity/v3/projects/7fea8d4a342a4f299da97c34d74edbfa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:27.252756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.256551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:27.287301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eda18-1603-4299-9b9f-a19f6350fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.288401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eda18-1603-4299-9b9f-a19f6350fb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.288733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eda18-1603-4299-9b9f-a19f6350fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.289015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eda18-1603-4299-9b9f-a19f6350fb1e admin admin] PATH_INFO: `/v3/projects/66cdcb4e9a6f477183a5d9404a284e4a/users/1f28d411cbfe42e7a575fdf723e30bb2/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.308248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3eda18-1603-4299-9b9f-a19f6350fb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66cdcb4e9a6f477183a5d9404a284e4a, user_id=1f28d411cbfe42e7a575fdf723e30bb2, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.312472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3eda18-1603-4299-9b9f-a19f6350fb1e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.330076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 956/1909] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:27 2022] PUT /identity/v3/projects/66cdcb4e9a6f477183a5d9404a284e4a/users/1f28d411cbfe42e7a575fdf723e30bb2/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:27.335728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de375d68-dcfb-466c-ab47-90843013fb9b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.342092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbebdc-40ae-42cc-9fd4-ecc7e2072fd1 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.342377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbebdc-40ae-42cc-9fd4-ecc7e2072fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.342668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbebdc-40ae-42cc-9fd4-ecc7e2072fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.379134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-66fbebdc-40ae-42cc-9fd4-ecc7e2072fd1 None None] MFA Rules not processed for user `1f28d411cbfe42e7a575fdf723e30bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:27.381224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-66fbebdc-40ae-42cc-9fd4-ecc7e2072fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:27.394023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:27.413774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.414758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.415061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.415335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] PATH_INFO: `/v3/users/112aeea3384a4d3197995d82bf99f2e6` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.416657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=112aeea3384a4d3197995d82bf99f2e6)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.418727 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.460176 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 957/1910] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:27.465193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbebdc-40ae-42cc-9fd4-ecc7e2072fd1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.466659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-66fbebdc-40ae-42cc-9fd4-ecc7e2072fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:27.471458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:27.478493 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112aeea3384a4d3197995d82bf99f2e6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:27.489695 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbebdc-40ae-42cc-9fd4-ecc7e2072fd1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.490369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112aeea3384a4d3197995d82bf99f2e6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:27.496998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62664ccb-8244-4381-9e21-916697ee734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.497737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664ccb-8244-4381-9e21-916697ee734f admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.498057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664ccb-8244-4381-9e21-916697ee734f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.498340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664ccb-8244-4381-9e21-916697ee734f admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.499117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62664ccb-8244-4381-9e21-916697ee734f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.501015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62664ccb-8244-4381-9e21-916697ee734f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.506927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112aeea3384a4d3197995d82bf99f2e6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:27.507494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112aeea3384a4d3197995d82bf99f2e6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:27.520450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112aeea3384a4d3197995d82bf99f2e6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:27.527921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 954/1911] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:27 2022] DELETE /identity/v3/users/112aeea3384a4d3197995d82bf99f2e6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:27.534211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 958/1912] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:27 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:27.538492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.539809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:27.628094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65648aa-132d-4e91-824e-75c208c45cea admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.706425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daae1e-54cf-4be6-afe0-75f5ede98c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.707170 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daae1e-54cf-4be6-afe0-75f5ede98c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.707499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daae1e-54cf-4be6-afe0-75f5ede98c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.709111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daae1e-54cf-4be6-afe0-75f5ede98c62 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.709846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daae1e-54cf-4be6-afe0-75f5ede98c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.711892 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daae1e-54cf-4be6-afe0-75f5ede98c62 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.734763 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 955/1913] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:27 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:27.739489 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62664ccb-8244-4381-9e21-916697ee734f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.749950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62664ccb-8244-4381-9e21-916697ee734f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.754841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824ff36-4846-49ee-88b6-8a757cdcc35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.755519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ff36-4846-49ee-88b6-8a757cdcc35b admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.755809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ff36-4846-49ee-88b6-8a757cdcc35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.756087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ff36-4846-49ee-88b6-8a757cdcc35b admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.756820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824ff36-4846-49ee-88b6-8a757cdcc35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.758566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824ff36-4846-49ee-88b6-8a757cdcc35b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.770871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 959/1914] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:27.775644 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daae1e-54cf-4be6-afe0-75f5ede98c62 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.793812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daae1e-54cf-4be6-afe0-75f5ede98c62 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.801502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d15a2-2b9d-46b9-a33f-9b8fb27ecfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.802731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d15a2-2b9d-46b9-a33f-9b8fb27ecfc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.803019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d15a2-2b9d-46b9-a33f-9b8fb27ecfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.810100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d15a2-2b9d-46b9-a33f-9b8fb27ecfc0 admin admin] PATH_INFO: `/v3/projects/6744ad49442c49d3b5ce15f6d423a4a8/users/c90c9603eb264a048c2781b1271b8b12/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.852936 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d15a2-2b9d-46b9-a33f-9b8fb27ecfc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6744ad49442c49d3b5ce15f6d423a4a8, user_id=c90c9603eb264a048c2781b1271b8b12, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.855839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d15a2-2b9d-46b9-a33f-9b8fb27ecfc0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.872620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 956/1915] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:27 2022] PUT /identity/v3/projects/6744ad49442c49d3b5ce15f6d423a4a8/users/c90c9603eb264a048c2781b1271b8b12/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:27.876625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824ff36-4846-49ee-88b6-8a757cdcc35b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.887592 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824ff36-4846-49ee-88b6-8a757cdcc35b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.949026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d15a2-2b9d-46b9-a33f-9b8fb27ecfc0 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.950863 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0f6d15a2-2b9d-46b9-a33f-9b8fb27ecfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:27.973599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9a8cc-9fcf-4701-bb0a-3aafa97bce01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.974367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a8cc-9fcf-4701-bb0a-3aafa97bce01 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.974669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a8cc-9fcf-4701-bb0a-3aafa97bce01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.974919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a8cc-9fcf-4701-bb0a-3aafa97bce01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.975795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9a8cc-9fcf-4701-bb0a-3aafa97bce01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.977559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9a8cc-9fcf-4701-bb0a-3aafa97bce01 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.993258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 960/1916] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:27.994207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9a8cc-9fcf-4701-bb0a-3aafa97bce01 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.999053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:28.006104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9a8cc-9fcf-4701-bb0a-3aafa97bce01 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.011332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05f905-0861-4b6a-a5da-a06f61ccbca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.012483 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f905-0861-4b6a-a5da-a06f61ccbca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.012770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f905-0861-4b6a-a5da-a06f61ccbca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.013051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f905-0861-4b6a-a5da-a06f61ccbca9 admin admin] PATH_INFO: `/v3/projects/6744ad49442c49d3b5ce15f6d423a4a8/users/c90c9603eb264a048c2781b1271b8b12/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.015648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05f905-0861-4b6a-a5da-a06f61ccbca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6744ad49442c49d3b5ce15f6d423a4a8, user_id=c90c9603eb264a048c2781b1271b8b12, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.018574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05f905-0861-4b6a-a5da-a06f61ccbca9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.042136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 961/1917] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:27 2022] PUT /identity/v3/projects/6744ad49442c49d3b5ce15f6d423a4a8/users/c90c9603eb264a048c2781b1271b8b12/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:28.052133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65b8a7-70b6-4873-8fad-42b9a5c038b9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.052391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d15a2-2b9d-46b9-a33f-9b8fb27ecfc0 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.052586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65b8a7-70b6-4873-8fad-42b9a5c038b9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.052875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65b8a7-70b6-4873-8fad-42b9a5c038b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.089862 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5d65b8a7-70b6-4873-8fad-42b9a5c038b9 None None] MFA Rules not processed for user `c90c9603eb264a048c2781b1271b8b12`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:28.091934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5d65b8a7-70b6-4873-8fad-42b9a5c038b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:28.130410 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.131144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.131426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.131699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] PATH_INFO: `/v3/projects/afa1a8f1e9bb4f489ebf8716b8b457a3` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.133033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa1a8f1e9bb4f489ebf8716b8b457a3)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.135136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.157170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:28.186090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 962/1918] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:28.193428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa1a8f1e9bb4f489ebf8716b8b457a3', 'request_id': 'req-7b230b21-67dc-4475-9603-3c54d1b7349b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:28.199404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65b8a7-70b6-4873-8fad-42b9a5c038b9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:28.201000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5d65b8a7-70b6-4873-8fad-42b9a5c038b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:28.203718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa1a8f1e9bb4f489ebf8716b8b457a3', 'request_id': 'req-7b230b21-67dc-4475-9603-3c54d1b7349b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:28.212269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa1a8f1e9bb4f489ebf8716b8b457a3', 'request_id': 'req-7b230b21-67dc-4475-9603-3c54d1b7349b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:28.224978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] The token cache is being invalidate because project afa1a8f1e9bb4f489ebf8716b8b457a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:28.225467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:28.226174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7b230b21-67dc-4475-9603-3c54d1b7349b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:28.227874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 957/1919] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:27 2022] DELETE /identity/v3/projects/afa1a8f1e9bb4f489ebf8716b8b457a3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:28.233913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1052f4-34c6-4f21-9ac4-c5c755f8cd69 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.234669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1052f4-34c6-4f21-9ac4-c5c755f8cd69 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.234959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1052f4-34c6-4f21-9ac4-c5c755f8cd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.254533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ab1052f4-34c6-4f21-9ac4-c5c755f8cd69 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:28.255748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ab1052f4-34c6-4f21-9ac4-c5c755f8cd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:28.261674 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65b8a7-70b6-4873-8fad-42b9a5c038b9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.312213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abbec2-20a2-484b-86c0-a11597e2aea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.312864 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abbec2-20a2-484b-86c0-a11597e2aea5 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.313140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abbec2-20a2-484b-86c0-a11597e2aea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.313981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abbec2-20a2-484b-86c0-a11597e2aea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.315837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-46abbec2-20a2-484b-86c0-a11597e2aea5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:28.320962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 958/1920] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:28.330635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17599b64-fc9b-4302-812f-924c1e19274a None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.330927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17599b64-fc9b-4302-812f-924c1e19274a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.331208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17599b64-fc9b-4302-812f-924c1e19274a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.343513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:28.350885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-17599b64-fc9b-4302-812f-924c1e19274a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:28.352718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-17599b64-fc9b-4302-812f-924c1e19274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:28.362345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 959/1921] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:28.366425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17599b64-fc9b-4302-812f-924c1e19274a None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:28.377294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17599b64-fc9b-4302-812f-924c1e19274a None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.382002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c9ee-b874-4041-aef6-33219db805c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.382675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c9ee-b874-4041-aef6-33219db805c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.383287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c9ee-b874-4041-aef6-33219db805c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.383287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c9ee-b874-4041-aef6-33219db805c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.383859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076c9ee-b874-4041-aef6-33219db805c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:28.384181 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076c9ee-b874-4041-aef6-33219db805c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.385749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076c9ee-b874-4041-aef6-33219db805c9 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.386654 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abbec2-20a2-484b-86c0-a11597e2aea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.388117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abbec2-20a2-484b-86c0-a11597e2aea5 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.398585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 963/1922] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:28.402175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 960/1923] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:56:28.403081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abbec2-20a2-484b-86c0-a11597e2aea5 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:28.413993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abbec2-20a2-484b-86c0-a11597e2aea5 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.418933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7c07-1466-4b66-8dba-20101e402d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.419582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7c07-1466-4b66-8dba-20101e402d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.419853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7c07-1466-4b66-8dba-20101e402d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.420833 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7c07-1466-4b66-8dba-20101e402d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.420833 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b7c07-1466-4b66-8dba-20101e402d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.423298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b7c07-1466-4b66-8dba-20101e402d31 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.428702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c9ee-b874-4041-aef6-33219db805c9 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:28.430723 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a076c9ee-b874-4041-aef6-33219db805c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:28.444451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c9ee-b874-4041-aef6-33219db805c9 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.449691 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83acc48-cd7c-47ea-8ee9-bf944a98e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.450630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83acc48-cd7c-47ea-8ee9-bf944a98e287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.451409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83acc48-cd7c-47ea-8ee9-bf944a98e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.451409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83acc48-cd7c-47ea-8ee9-bf944a98e287 admin admin] PATH_INFO: `/v3/users/1f28d411cbfe42e7a575fdf723e30bb2` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.452399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83acc48-cd7c-47ea-8ee9-bf944a98e287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f28d411cbfe42e7a575fdf723e30bb2)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.454060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 964/1924] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:28 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:28.454424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83acc48-cd7c-47ea-8ee9-bf944a98e287 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.459042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7c07-1466-4b66-8dba-20101e402d31 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:28.499766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:28.515803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a83acc48-cd7c-47ea-8ee9-bf944a98e287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f28d411cbfe42e7a575fdf723e30bb2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:28.523142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a83acc48-cd7c-47ea-8ee9-bf944a98e287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f28d411cbfe42e7a575fdf723e30bb2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:28.536803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a83acc48-cd7c-47ea-8ee9-bf944a98e287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f28d411cbfe42e7a575fdf723e30bb2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:28.537547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a83acc48-cd7c-47ea-8ee9-bf944a98e287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f28d411cbfe42e7a575fdf723e30bb2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:28.538053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7c07-1466-4b66-8dba-20101e402d31 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.543679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f6031-5bbf-4950-b464-24a7e75ebeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.544406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6031-5bbf-4950-b464-24a7e75ebeee admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.544697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6031-5bbf-4950-b464-24a7e75ebeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.545020 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6031-5bbf-4950-b464-24a7e75ebeee admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.545738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f6031-5bbf-4950-b464-24a7e75ebeee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.546814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a83acc48-cd7c-47ea-8ee9-bf944a98e287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f28d411cbfe42e7a575fdf723e30bb2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:28.549521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f6031-5bbf-4950-b464-24a7e75ebeee admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.558894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 961/1925] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:28 2022] DELETE /identity/v3/users/1f28d411cbfe42e7a575fdf723e30bb2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:28.560908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c821bfb-d97a-42ca-9e8b-aafb510509d5 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.561256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c821bfb-d97a-42ca-9e8b-aafb510509d5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.561758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c821bfb-d97a-42ca-9e8b-aafb510509d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.577938 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 965/1926] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:28 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:28.580998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-7c821bfb-d97a-42ca-9e8b-aafb510509d5 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:28.581818 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f6031-5bbf-4950-b464-24a7e75ebeee admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:28.582425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7c821bfb-d97a-42ca-9e8b-aafb510509d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:28.584369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-724f6031-5bbf-4950-b464-24a7e75ebeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:28.597292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f6031-5bbf-4950-b464-24a7e75ebeee admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.648638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 962/1927] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:28.661354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c821bfb-d97a-42ca-9e8b-aafb510509d5 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:28.662576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7c821bfb-d97a-42ca-9e8b-aafb510509d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:28.668240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad3985-d33b-4d00-ba14-cae8490976c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.669010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad3985-d33b-4d00-ba14-cae8490976c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.669385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad3985-d33b-4d00-ba14-cae8490976c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.669753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad3985-d33b-4d00-ba14-cae8490976c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.670822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad3985-d33b-4d00-ba14-cae8490976c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.672449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad3985-d33b-4d00-ba14-cae8490976c7 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.684075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 966/1928] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:28.687758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad3985-d33b-4d00-ba14-cae8490976c7 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:28.699256 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad3985-d33b-4d00-ba14-cae8490976c7 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.704849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978a1da-0f58-4029-b064-83c92f69188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.705524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a1da-0f58-4029-b064-83c92f69188a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.705810 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a1da-0f58-4029-b064-83c92f69188a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.706122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a1da-0f58-4029-b064-83c92f69188a admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.706849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978a1da-0f58-4029-b064-83c92f69188a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.708681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978a1da-0f58-4029-b064-83c92f69188a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.719542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 967/1929] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:28.725374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978a1da-0f58-4029-b064-83c92f69188a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:28.733097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c821bfb-d97a-42ca-9e8b-aafb510509d5 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.736344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978a1da-0f58-4029-b064-83c92f69188a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.737768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bbd5f-a33d-41e7-ab6f-87b686caeb3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.738501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bbd5f-a33d-41e7-ab6f-87b686caeb3c service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.738784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bbd5f-a33d-41e7-ab6f-87b686caeb3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.739060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bbd5f-a33d-41e7-ab6f-87b686caeb3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.744341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68f1e8-c4cb-43ee-b53b-be054e3f81c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.746712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68f1e8-c4cb-43ee-b53b-be054e3f81c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.746712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68f1e8-c4cb-43ee-b53b-be054e3f81c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.746920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68f1e8-c4cb-43ee-b53b-be054e3f81c6 admin admin] PATH_INFO: `/v3/projects/d78e633127494721b30fdbf4acc578b7/users/1bae51656c3f47d487504c2a6a05f7b6/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.748600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bbd5f-a33d-41e7-ab6f-87b686caeb3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.750076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bbd5f-a33d-41e7-ab6f-87b686caeb3c service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.761953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 963/1930] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:28.764035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68f1e8-c4cb-43ee-b53b-be054e3f81c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d78e633127494721b30fdbf4acc578b7, user_id=1bae51656c3f47d487504c2a6a05f7b6, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.769153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68f1e8-c4cb-43ee-b53b-be054e3f81c6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.786036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 968/1931] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:28 2022] PUT /identity/v3/projects/d78e633127494721b30fdbf4acc578b7/users/1bae51656c3f47d487504c2a6a05f7b6/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:28.797467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59e36b-e59c-48c6-a83a-02cdeb1bb8b6 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.797793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59e36b-e59c-48c6-a83a-02cdeb1bb8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.798113 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59e36b-e59c-48c6-a83a-02cdeb1bb8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.804412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:28.842778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-cf59e36b-e59c-48c6-a83a-02cdeb1bb8b6 None None] MFA Rules not processed for user `1bae51656c3f47d487504c2a6a05f7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:28.844654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-cf59e36b-e59c-48c6-a83a-02cdeb1bb8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:28.939539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 964/1932] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:28.941508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68f1e8-c4cb-43ee-b53b-be054e3f81c6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.013367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68f1e8-c4cb-43ee-b53b-be054e3f81c6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:29.020150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916acb-a0b3-41df-b0d9-371202fe58c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:29.021048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916acb-a0b3-41df-b0d9-371202fe58c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.021652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916acb-a0b3-41df-b0d9-371202fe58c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.022108 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916acb-a0b3-41df-b0d9-371202fe58c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.023146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d916acb-a0b3-41df-b0d9-371202fe58c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:29.025963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d916acb-a0b3-41df-b0d9-371202fe58c8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:29.071398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59e36b-e59c-48c6-a83a-02cdeb1bb8b6 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.073292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-cf59e36b-e59c-48c6-a83a-02cdeb1bb8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:29.073547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 969/1933] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:28 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:29.077533 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916acb-a0b3-41df-b0d9-371202fe58c8 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.098782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59e36b-e59c-48c6-a83a-02cdeb1bb8b6 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:29.099757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:29.160405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916acb-a0b3-41df-b0d9-371202fe58c8 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:29.166814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b3fa7-c95b-4236-a9b6-c4a1e9195ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:29.167565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b3fa7-c95b-4236-a9b6-c4a1e9195ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.167853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b3fa7-c95b-4236-a9b6-c4a1e9195ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.168129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b3fa7-c95b-4236-a9b6-c4a1e9195ed3 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.168828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b3fa7-c95b-4236-a9b6-c4a1e9195ed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:29.170860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b3fa7-c95b-4236-a9b6-c4a1e9195ed3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:29.173958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:29.175533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.175814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.176089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] PATH_INFO: `/v3/projects/66cdcb4e9a6f477183a5d9404a284e4a` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.177817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66cdcb4e9a6f477183a5d9404a284e4a)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:29.179753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:29.200131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 970/1934] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:29 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:29.204061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b3fa7-c95b-4236-a9b6-c4a1e9195ed3 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.218190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b3fa7-c95b-4236-a9b6-c4a1e9195ed3 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:29.223982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e3c15-1bfc-471f-85c4-0de036899c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:29.224738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3c15-1bfc-471f-85c4-0de036899c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.224858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3c15-1bfc-471f-85c4-0de036899c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.225114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3c15-1bfc-471f-85c4-0de036899c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.225947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e3c15-1bfc-471f-85c4-0de036899c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:29.227449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e3c15-1bfc-471f-85c4-0de036899c11 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:29.238746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 971/1935] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:29.243078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e3c15-1bfc-471f-85c4-0de036899c11 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.246159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66cdcb4e9a6f477183a5d9404a284e4a', 'request_id': 'req-1390e0a1-281b-404a-8d71-a13b8bfc9766'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.255212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e3c15-1bfc-471f-85c4-0de036899c11 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:29.262784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66cdcb4e9a6f477183a5d9404a284e4a', 'request_id': 'req-1390e0a1-281b-404a-8d71-a13b8bfc9766'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.274610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66cdcb4e9a6f477183a5d9404a284e4a', 'request_id': 'req-1390e0a1-281b-404a-8d71-a13b8bfc9766'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.291729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] The token cache is being invalidate because project 66cdcb4e9a6f477183a5d9404a284e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:29.292017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.292718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.294827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 965/1936] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:29 2022] DELETE /identity/v3/projects/66cdcb4e9a6f477183a5d9404a284e4a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:29.303537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.307483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:29.340388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec4da7-46f3-47dd-abf2-9c0bc071be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:29.342770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4da7-46f3-47dd-abf2-9c0bc071be76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.343184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4da7-46f3-47dd-abf2-9c0bc071be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.343559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4da7-46f3-47dd-abf2-9c0bc071be76 admin admin] PATH_INFO: `/v3/projects/58d7d5bc5e4e482cb9f6b12575b59032/users/4666b44532f34fcb9bf5893087d5652c/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.345976 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:29.362307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec4da7-46f3-47dd-abf2-9c0bc071be76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d7d5bc5e4e482cb9f6b12575b59032, user_id=4666b44532f34fcb9bf5893087d5652c, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:29.365356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec4da7-46f3-47dd-abf2-9c0bc071be76 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:29.381462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 972/1937] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:29 2022] PUT /identity/v3/projects/58d7d5bc5e4e482cb9f6b12575b59032/users/4666b44532f34fcb9bf5893087d5652c/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:29.385336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec4da7-46f3-47dd-abf2-9c0bc071be76 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.387056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a3ec4da7-46f3-47dd-abf2-9c0bc071be76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:29.400409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390e0a1-281b-404a-8d71-a13b8bfc9766 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:29.455362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec4da7-46f3-47dd-abf2-9c0bc071be76 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:29.460126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1984c-772c-498b-b4b5-75948986e8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:29.460799 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1984c-772c-498b-b4b5-75948986e8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.461090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1984c-772c-498b-b4b5-75948986e8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.461366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1984c-772c-498b-b4b5-75948986e8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.462185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1984c-772c-498b-b4b5-75948986e8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:29.463792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1984c-772c-498b-b4b5-75948986e8d4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:29.463914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:29.464730 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.465018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.465289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] PATH_INFO: `/v3/users/c90c9603eb264a048c2781b1271b8b12` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.466837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90c9603eb264a048c2781b1271b8b12)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:29.468734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:29.474962 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 973/1938] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:29.478938 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1984c-772c-498b-b4b5-75948986e8d4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.484971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:29.489219 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1984c-772c-498b-b4b5-75948986e8d4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:29.495808 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e00d9-9813-4919-9639-3b3c14c00258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:29.496966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e00d9-9813-4919-9639-3b3c14c00258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.497325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e00d9-9813-4919-9639-3b3c14c00258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.497613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e00d9-9813-4919-9639-3b3c14c00258 admin admin] PATH_INFO: `/v3/projects/58d7d5bc5e4e482cb9f6b12575b59032/users/4666b44532f34fcb9bf5893087d5652c/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.501371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e00d9-9813-4919-9639-3b3c14c00258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d7d5bc5e4e482cb9f6b12575b59032, user_id=4666b44532f34fcb9bf5893087d5652c, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:29.504463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e00d9-9813-4919-9639-3b3c14c00258 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:29.520138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 974/1939] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:29 2022] PUT /identity/v3/projects/58d7d5bc5e4e482cb9f6b12575b59032/users/4666b44532f34fcb9bf5893087d5652c/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:29.525377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90c9603eb264a048c2781b1271b8b12'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.538710 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90c9603eb264a048c2781b1271b8b12'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.539309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344ffc8-d2c5-4ef6-b21a-3604f770ee66 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.539903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344ffc8-d2c5-4ef6-b21a-3604f770ee66 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.540017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344ffc8-d2c5-4ef6-b21a-3604f770ee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.554035 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90c9603eb264a048c2781b1271b8b12'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.554771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90c9603eb264a048c2781b1271b8b12'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.564068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90c9603eb264a048c2781b1271b8b12'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.567091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6344ffc8-d2c5-4ef6-b21a-3604f770ee66 None None] MFA Rules not processed for user `4666b44532f34fcb9bf5893087d5652c`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:29.568312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6344ffc8-d2c5-4ef6-b21a-3604f770ee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:29.570661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 966/1940] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:29 2022] DELETE /identity/v3/users/c90c9603eb264a048c2781b1271b8b12 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:29.658875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 975/1941] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:29.668992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.670485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:29.746619 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:29.753784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326e289-35ed-46d7-8b42-146cbd772b1f admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:29.762200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3bd8f-33cc-482f-a35d-ff089292f41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:29.762853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3bd8f-33cc-482f-a35d-ff089292f41d service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.763150 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3bd8f-33cc-482f-a35d-ff089292f41d service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.763897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3bd8f-33cc-482f-a35d-ff089292f41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.780813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3bd8f-33cc-482f-a35d-ff089292f41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:29.782515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3bd8f-33cc-482f-a35d-ff089292f41d service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:29.794587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 967/1942] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:29.884354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344ffc8-d2c5-4ef6-b21a-3604f770ee66 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.895536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344ffc8-d2c5-4ef6-b21a-3604f770ee66 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:29.900114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46510ead-fc5a-4e0d-86c0-f9462eaab284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:29.900955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46510ead-fc5a-4e0d-86c0-f9462eaab284 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.901380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46510ead-fc5a-4e0d-86c0-f9462eaab284 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.901910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46510ead-fc5a-4e0d-86c0-f9462eaab284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.903932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-46510ead-fc5a-4e0d-86c0-f9462eaab284 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:29.935678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3bd8f-33cc-482f-a35d-ff089292f41d service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.937423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5ba3bd8f-33cc-482f-a35d-ff089292f41d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:30.031741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46510ead-fc5a-4e0d-86c0-f9462eaab284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:30.032709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3bd8f-33cc-482f-a35d-ff089292f41d service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:30.034746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46510ead-fc5a-4e0d-86c0-f9462eaab284 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:30.042431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:30.043994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.044837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.045313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] PATH_INFO: `/v3/projects/6744ad49442c49d3b5ce15f6d423a4a8` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.047072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6744ad49442c49d3b5ce15f6d423a4a8)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:30.051755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:30.063047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 976/1943] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:30.120824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6744ad49442c49d3b5ce15f6d423a4a8', 'request_id': 'req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:30.131259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6744ad49442c49d3b5ce15f6d423a4a8', 'request_id': 'req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:30.143470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6744ad49442c49d3b5ce15f6d423a4a8', 'request_id': 'req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:30.160148 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] The token cache is being invalidate because project 6744ad49442c49d3b5ce15f6d423a4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:30.160443 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:30.161114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c0e5e8d5-dce4-46bb-b2fe-7542f1763bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:30.166044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 968/1944] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:29 2022] DELETE /identity/v3/projects/6744ad49442c49d3b5ce15f6d423a4a8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:30.168442 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be5da-9138-4413-8493-7de955ef10c6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.168888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be5da-9138-4413-8493-7de955ef10c6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.169315 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be5da-9138-4413-8493-7de955ef10c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.193498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a97be5da-9138-4413-8493-7de955ef10c6 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:30.195677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a97be5da-9138-4413-8493-7de955ef10c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:30.268997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 977/1945] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:30.277293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38b8c-6024-444a-bfcf-139883959178 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.277544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38b8c-6024-444a-bfcf-139883959178 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.277920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38b8c-6024-444a-bfcf-139883959178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.308172 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-41c38b8c-6024-444a-bfcf-139883959178 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:30.309561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-41c38b8c-6024-444a-bfcf-139883959178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:30.320460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 969/1946] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:30.325090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97be5da-9138-4413-8493-7de955ef10c6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:30.339797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97be5da-9138-4413-8493-7de955ef10c6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:30.346008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c7bae-ea54-4e7e-b198-f56c83b26d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:30.347046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c7bae-ea54-4e7e-b198-f56c83b26d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.347427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c7bae-ea54-4e7e-b198-f56c83b26d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.347802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c7bae-ea54-4e7e-b198-f56c83b26d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.348896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c7bae-ea54-4e7e-b198-f56c83b26d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:30.349224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c7bae-ea54-4e7e-b198-f56c83b26d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:30.351656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c7bae-ea54-4e7e-b198-f56c83b26d34 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:30.378273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 978/1947] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:30.383402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38b8c-6024-444a-bfcf-139883959178 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:30.401345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38b8c-6024-444a-bfcf-139883959178 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:30.406321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992bd97-9240-4383-a20a-5a8c44f26dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:30.407062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992bd97-9240-4383-a20a-5a8c44f26dca admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.407352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992bd97-9240-4383-a20a-5a8c44f26dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.408173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992bd97-9240-4383-a20a-5a8c44f26dca admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.409449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992bd97-9240-4383-a20a-5a8c44f26dca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:30.410945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992bd97-9240-4383-a20a-5a8c44f26dca admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:30.449920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 970/1948] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:30 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:30.453220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c7bae-ea54-4e7e-b198-f56c83b26d34 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:30.459432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:30.467232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c7bae-ea54-4e7e-b198-f56c83b26d34 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:30.533312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace094d-97ea-47f9-928b-113f47d1d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:30.534233 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace094d-97ea-47f9-928b-113f47d1d827 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.534518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace094d-97ea-47f9-928b-113f47d1d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.534795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace094d-97ea-47f9-928b-113f47d1d827 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.535494 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace094d-97ea-47f9-928b-113f47d1d827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:30.537428 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace094d-97ea-47f9-928b-113f47d1d827 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:30.558252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 979/1949] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:30 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:30.562405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992bd97-9240-4383-a20a-5a8c44f26dca admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:30.574840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992bd97-9240-4383-a20a-5a8c44f26dca admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:30.580064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fb881-3db9-4340-897d-290588200723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:30.580728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fb881-3db9-4340-897d-290588200723 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.581008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fb881-3db9-4340-897d-290588200723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.581279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fb881-3db9-4340-897d-290588200723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.582023 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fb881-3db9-4340-897d-290588200723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:30.583968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fb881-3db9-4340-897d-290588200723 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:30.597229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 971/1950] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:30.599179 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace094d-97ea-47f9-928b-113f47d1d827 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:30.609913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace094d-97ea-47f9-928b-113f47d1d827 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:30.614971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b5836-41d9-44e8-a57c-96757f90c476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:30.615637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b5836-41d9-44e8-a57c-96757f90c476 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.615922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b5836-41d9-44e8-a57c-96757f90c476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.616200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b5836-41d9-44e8-a57c-96757f90c476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.616921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b5836-41d9-44e8-a57c-96757f90c476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:30.618626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b5836-41d9-44e8-a57c-96757f90c476 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:30.629119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 980/1951] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:30.633183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fb881-3db9-4340-897d-290588200723 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:30.644209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fb881-3db9-4340-897d-290588200723 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:30.648772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9320f-6e06-4094-a8c8-87c44f96404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:30.649961 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9320f-6e06-4094-a8c8-87c44f96404b admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.650252 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9320f-6e06-4094-a8c8-87c44f96404b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.650505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9320f-6e06-4094-a8c8-87c44f96404b admin admin] PATH_INFO: `/v3/projects/9189ddeadcc2467e8ef5408a7547cffe/users/f37a7a9c01814c948dc6fa7cc5615159/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.668717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9320f-6e06-4094-a8c8-87c44f96404b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9189ddeadcc2467e8ef5408a7547cffe, user_id=f37a7a9c01814c948dc6fa7cc5615159, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:30.671439 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9320f-6e06-4094-a8c8-87c44f96404b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:30.685098 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 972/1952] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:30 2022] PUT /identity/v3/projects/9189ddeadcc2467e8ef5408a7547cffe/users/f37a7a9c01814c948dc6fa7cc5615159/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:30.696893 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04012a39-5e14-4c67-9614-3f17dc745ada None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.697184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04012a39-5e14-4c67-9614-3f17dc745ada None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.697465 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04012a39-5e14-4c67-9614-3f17dc745ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.725626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-04012a39-5e14-4c67-9614-3f17dc745ada None None] MFA Rules not processed for user `f37a7a9c01814c948dc6fa7cc5615159`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:30.726884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-04012a39-5e14-4c67-9614-3f17dc745ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:30.794270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 981/1953] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:30.798937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9320f-6e06-4094-a8c8-87c44f96404b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:30.822262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:30.887426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9320f-6e06-4094-a8c8-87c44f96404b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:30.895733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7de587-e213-47c6-9610-089b3cd38879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:30.896525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7de587-e213-47c6-9610-089b3cd38879 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.896925 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7de587-e213-47c6-9610-089b3cd38879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.897279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7de587-e213-47c6-9610-089b3cd38879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.898263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7de587-e213-47c6-9610-089b3cd38879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:30.900826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7de587-e213-47c6-9610-089b3cd38879 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:30.933940 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 973/1954] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:30 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:30.935355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04012a39-5e14-4c67-9614-3f17dc745ada None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:30.946911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04012a39-5e14-4c67-9614-3f17dc745ada None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:31.008095 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd910a08-e2de-41fe-b4f3-aab57abd12be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:31.008765 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd910a08-e2de-41fe-b4f3-aab57abd12be admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.009051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd910a08-e2de-41fe-b4f3-aab57abd12be admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.009325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd910a08-e2de-41fe-b4f3-aab57abd12be admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.010055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd910a08-e2de-41fe-b4f3-aab57abd12be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:31.011977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd910a08-e2de-41fe-b4f3-aab57abd12be admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:31.027574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:31.034058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 982/1955] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:30 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:31.037650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7de587-e213-47c6-9610-089b3cd38879 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:31.050489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7de587-e213-47c6-9610-089b3cd38879 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:31.055236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1baf6-9c82-4677-865f-f266569a061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:31.055907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1baf6-9c82-4677-865f-f266569a061a admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.056193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1baf6-9c82-4677-865f-f266569a061a admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.056470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1baf6-9c82-4677-865f-f266569a061a admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.057191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1baf6-9c82-4677-865f-f266569a061a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:31.059460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1baf6-9c82-4677-865f-f266569a061a admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:31.074879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 974/1956] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:31.076149 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd910a08-e2de-41fe-b4f3-aab57abd12be admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:31.087370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd910a08-e2de-41fe-b4f3-aab57abd12be admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:31.092080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9591f4a-6823-4455-b6a6-f6feb3949dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:31.092994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9591f4a-6823-4455-b6a6-f6feb3949dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.093278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9591f4a-6823-4455-b6a6-f6feb3949dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.093549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9591f4a-6823-4455-b6a6-f6feb3949dbb admin admin] PATH_INFO: `/v3/projects/9fe44016147c4d88a5a9869b758d753d/users/21c53ea211db45e99651149597c487a5/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.108546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9591f4a-6823-4455-b6a6-f6feb3949dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe44016147c4d88a5a9869b758d753d, user_id=21c53ea211db45e99651149597c487a5, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:31.111841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9591f4a-6823-4455-b6a6-f6feb3949dbb admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:31.125486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 983/1957] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:31 2022] PUT /identity/v3/projects/9fe44016147c4d88a5a9869b758d753d/users/21c53ea211db45e99651149597c487a5/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:31.129974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1baf6-9c82-4677-865f-f266569a061a admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:31.140442 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1baf6-9c82-4677-865f-f266569a061a admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:31.199778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3639135-9a34-4fe7-aca4-5ac9c8508176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:31.200457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3639135-9a34-4fe7-aca4-5ac9c8508176 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.200746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3639135-9a34-4fe7-aca4-5ac9c8508176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.201026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3639135-9a34-4fe7-aca4-5ac9c8508176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.202217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3639135-9a34-4fe7-aca4-5ac9c8508176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:31.203828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3639135-9a34-4fe7-aca4-5ac9c8508176 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:31.213801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 975/1958] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:31.217965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9591f4a-6823-4455-b6a6-f6feb3949dbb admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:31.228527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9591f4a-6823-4455-b6a6-f6feb3949dbb admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:31.233132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd2718-e87e-4df9-be2c-a754cad7d1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:31.234042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2718-e87e-4df9-be2c-a754cad7d1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.234323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2718-e87e-4df9-be2c-a754cad7d1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.234593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2718-e87e-4df9-be2c-a754cad7d1c2 admin admin] PATH_INFO: `/v3/projects/9fe44016147c4d88a5a9869b758d753d/users/21c53ea211db45e99651149597c487a5/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.237403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd2718-e87e-4df9-be2c-a754cad7d1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe44016147c4d88a5a9869b758d753d, user_id=21c53ea211db45e99651149597c487a5, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:31.240072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd2718-e87e-4df9-be2c-a754cad7d1c2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:31.252667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 984/1959] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:31 2022] PUT /identity/v3/projects/9fe44016147c4d88a5a9869b758d753d/users/21c53ea211db45e99651149597c487a5/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:31.262422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0c69-92c2-4d54-a70b-99208d451aba None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.262713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0c69-92c2-4d54-a70b-99208d451aba None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.263014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0c69-92c2-4d54-a70b-99208d451aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.291463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-635f0c69-92c2-4d54-a70b-99208d451aba None None] MFA Rules not processed for user `21c53ea211db45e99651149597c487a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:31.292692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-635f0c69-92c2-4d54-a70b-99208d451aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:31.372156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 976/1960] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:31.385577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd2718-e87e-4df9-be2c-a754cad7d1c2 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:31.387491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d0fd2718-e87e-4df9-be2c-a754cad7d1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:31.450583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd2718-e87e-4df9-be2c-a754cad7d1c2 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:31.454965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac8e13-4fa0-4f5b-b0e2-5e348dd2b976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:31.455619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8e13-4fa0-4f5b-b0e2-5e348dd2b976 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.455901 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8e13-4fa0-4f5b-b0e2-5e348dd2b976 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.456171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8e13-4fa0-4f5b-b0e2-5e348dd2b976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.465818 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac8e13-4fa0-4f5b-b0e2-5e348dd2b976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:31.467366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac8e13-4fa0-4f5b-b0e2-5e348dd2b976 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:31.478296 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 985/1961] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:31.891597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0c69-92c2-4d54-a70b-99208d451aba None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:31.901467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0c69-92c2-4d54-a70b-99208d451aba None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:31.906166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32008633-f916-4e71-8f57-fde0fc31a8bc tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c53ea211db45e99651149597c487a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe44016147c4d88a5a9869b758d753d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:31.906826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008633-f916-4e71-8f57-fde0fc31a8bc tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.907293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008633-f916-4e71-8f57-fde0fc31a8bc tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.907567 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008633-f916-4e71-8f57-fde0fc31a8bc tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.908288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32008633-f916-4e71-8f57-fde0fc31a8bc tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:31.908594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32008633-f916-4e71-8f57-fde0fc31a8bc tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:31.910209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32008633-f916-4e71-8f57-fde0fc31a8bc tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:31.919093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:31.925922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 977/1962] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:31.928148 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac8e13-4fa0-4f5b-b0e2-5e348dd2b976 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:31.937198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac8e13-4fa0-4f5b-b0e2-5e348dd2b976 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:31.942392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8005383-bc19-4ead-a306-cd808e02cc98 tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c53ea211db45e99651149597c487a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe44016147c4d88a5a9869b758d753d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:31.943037 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8005383-bc19-4ead-a306-cd808e02cc98 tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.943325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8005383-bc19-4ead-a306-cd808e02cc98 tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.943598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8005383-bc19-4ead-a306-cd808e02cc98 tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.944304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8005383-bc19-4ead-a306-cd808e02cc98 tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:31.946183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8005383-bc19-4ead-a306-cd808e02cc98 tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:31.972513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 986/1963] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:31 2022] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:31.976487 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32008633-f916-4e71-8f57-fde0fc31a8bc tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:31.987163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32008633-f916-4e71-8f57-fde0fc31a8bc tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:32.048744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693fe1e-fe23-494c-ac21-4c7d0169894a tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c53ea211db45e99651149597c487a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe44016147c4d88a5a9869b758d753d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:32.049471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693fe1e-fe23-494c-ac21-4c7d0169894a tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.049696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693fe1e-fe23-494c-ac21-4c7d0169894a tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.050018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693fe1e-fe23-494c-ac21-4c7d0169894a tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.050745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693fe1e-fe23-494c-ac21-4c7d0169894a tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:32.051053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693fe1e-fe23-494c-ac21-4c7d0169894a tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:32.052677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693fe1e-fe23-494c-ac21-4c7d0169894a tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:32.067305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 978/1964] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:32.113931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8005383-bc19-4ead-a306-cd808e02cc98 tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:32.124451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8005383-bc19-4ead-a306-cd808e02cc98 tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:32.129234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c53ea211db45e99651149597c487a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fe44016147c4d88a5a9869b758d753d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:32.130118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.130396 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.130666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] PATH_INFO: `/v3/projects/7b8fbb3d2d1e49db952877402ddbd7a3` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.131838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7b8fbb3d2d1e49db952877402ddbd7a3)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:32.133717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:32.181209 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8fbb3d2d1e49db952877402ddbd7a3', 'request_id': 'req-825bfaff-29e6-483b-9750-714bf73ea7fd'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.189019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8fbb3d2d1e49db952877402ddbd7a3', 'request_id': 'req-825bfaff-29e6-483b-9750-714bf73ea7fd'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.195289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8fbb3d2d1e49db952877402ddbd7a3', 'request_id': 'req-825bfaff-29e6-483b-9750-714bf73ea7fd'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.206036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] The token cache is being invalidate because project 7b8fbb3d2d1e49db952877402ddbd7a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:32.206324 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.206976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-825bfaff-29e6-483b-9750-714bf73ea7fd tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.208520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 987/1965] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:32 2022] DELETE /identity/v3/projects/7b8fbb3d2d1e49db952877402ddbd7a3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:32.438428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693fe1e-fe23-494c-ac21-4c7d0169894a tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:32.440521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c693fe1e-fe23-494c-ac21-4c7d0169894a tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:32.519159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693fe1e-fe23-494c-ac21-4c7d0169894a tempest-VolumeQuotaClassesTest-1243187967 tempest-VolumeQuotaClassesTest-1243187967-project-admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:32.593597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:32.595610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.595610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.596098 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] PATH_INFO: `/v3/users/f37a7a9c01814c948dc6fa7cc5615159` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.597455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37a7a9c01814c948dc6fa7cc5615159)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:32.599585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:32.662844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:32.666893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37a7a9c01814c948dc6fa7cc5615159'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.677807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37a7a9c01814c948dc6fa7cc5615159'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.694670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37a7a9c01814c948dc6fa7cc5615159'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.695418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37a7a9c01814c948dc6fa7cc5615159'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.704520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37a7a9c01814c948dc6fa7cc5615159'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.711767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 979/1966] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:32 2022] DELETE /identity/v3/users/f37a7a9c01814c948dc6fa7cc5615159 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:32.716270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca7c78-5eda-4525-a425-0eb36451fe52 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.716809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca7c78-5eda-4525-a425-0eb36451fe52 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.716809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca7c78-5eda-4525-a425-0eb36451fe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.736483 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8aca7c78-5eda-4525-a425-0eb36451fe52 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:32.737773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8aca7c78-5eda-4525-a425-0eb36451fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:32.760157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:32.805414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 988/1967] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:32.816093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:32.818464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:32.889701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09368658-eae9-4655-9329-f40962962d05 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:32.894109 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b8d90-b8dc-459d-a446-5be0d02c23d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:32.894762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b8d90-b8dc-459d-a446-5be0d02c23d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.895041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b8d90-b8dc-459d-a446-5be0d02c23d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.895322 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b8d90-b8dc-459d-a446-5be0d02c23d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.905668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b8d90-b8dc-459d-a446-5be0d02c23d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:32.907279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b8d90-b8dc-459d-a446-5be0d02c23d7 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:32.918051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 980/1968] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:33.327227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca7c78-5eda-4525-a425-0eb36451fe52 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:33.329402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8aca7c78-5eda-4525-a425-0eb36451fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:33.347494 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca7c78-5eda-4525-a425-0eb36451fe52 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:33.353465 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:33.355250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:33.355587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:33.355941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] PATH_INFO: `/v3/projects/9189ddeadcc2467e8ef5408a7547cffe` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:33.357370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9189ddeadcc2467e8ef5408a7547cffe)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:33.359426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:33.425930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9189ddeadcc2467e8ef5408a7547cffe', 'request_id': 'req-83807cd5-0769-4a5d-9c5a-f95975bc340a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:33.434840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9189ddeadcc2467e8ef5408a7547cffe', 'request_id': 'req-83807cd5-0769-4a5d-9c5a-f95975bc340a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:33.441488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9189ddeadcc2467e8ef5408a7547cffe', 'request_id': 'req-83807cd5-0769-4a5d-9c5a-f95975bc340a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:33.455323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] The token cache is being invalidate because project 9189ddeadcc2467e8ef5408a7547cffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:33.455611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:33.456280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:33.460659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 989/1969] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:33 2022] DELETE /identity/v3/projects/9189ddeadcc2467e8ef5408a7547cffe => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:33.461859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b8d90-b8dc-459d-a446-5be0d02c23d7 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:33.472828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b8d90-b8dc-459d-a446-5be0d02c23d7 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:33.545108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f81b75-fd5c-49a0-bcba-46a918187d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:33.546030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f81b75-fd5c-49a0-bcba-46a918187d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:33.546318 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f81b75-fd5c-49a0-bcba-46a918187d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:33.546596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f81b75-fd5c-49a0-bcba-46a918187d0e admin admin] PATH_INFO: `/v3/users/21c53ea211db45e99651149597c487a5` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:33.548880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f81b75-fd5c-49a0-bcba-46a918187d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c53ea211db45e99651149597c487a5)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:33.550312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f81b75-fd5c-49a0-bcba-46a918187d0e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:33.604705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-47f81b75-fd5c-49a0-bcba-46a918187d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c53ea211db45e99651149597c487a5'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:33.616467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-47f81b75-fd5c-49a0-bcba-46a918187d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c53ea211db45e99651149597c487a5'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:33.623729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:33.634963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-47f81b75-fd5c-49a0-bcba-46a918187d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c53ea211db45e99651149597c487a5'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:33.636014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-47f81b75-fd5c-49a0-bcba-46a918187d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c53ea211db45e99651149597c487a5'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:33.644353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-47f81b75-fd5c-49a0-bcba-46a918187d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c53ea211db45e99651149597c487a5'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:33.653666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 981/1970] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:33 2022] DELETE /identity/v3/users/21c53ea211db45e99651149597c487a5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:34.117823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.119444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:34.145488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807cd5-0769-4a5d-9c5a-f95975bc340a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.209218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.210160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.210446 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.211137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] PATH_INFO: `/v3/projects/9fe44016147c4d88a5a9869b758d753d` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.212031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe44016147c4d88a5a9869b758d753d)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.213976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.263898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe44016147c4d88a5a9869b758d753d', 'request_id': 'req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:34.266964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:34.275252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe44016147c4d88a5a9869b758d753d', 'request_id': 'req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:34.283581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe44016147c4d88a5a9869b758d753d', 'request_id': 'req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:34.294399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] The token cache is being invalidate because project 9fe44016147c4d88a5a9869b758d753d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:34.294732 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:34.295391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b57b895-1429-46f0-b4b0-ae1d9ab8d7e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:34.296958 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 990/1971] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:34 2022] DELETE /identity/v3/projects/9fe44016147c4d88a5a9869b758d753d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:34.302579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edc24-dc32-48fb-b73b-61f6bf320b00 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.303039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edc24-dc32-48fb-b73b-61f6bf320b00 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.303145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edc24-dc32-48fb-b73b-61f6bf320b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.321531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c69edc24-dc32-48fb-b73b-61f6bf320b00 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:34.322794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c69edc24-dc32-48fb-b73b-61f6bf320b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:34.394330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 982/1972] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:34.396091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632b3cb-d12a-437e-a478-bee8b87fdf20 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.396380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632b3cb-d12a-437e-a478-bee8b87fdf20 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.396656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632b3cb-d12a-437e-a478-bee8b87fdf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.416420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e632b3cb-d12a-437e-a478-bee8b87fdf20 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:34.417635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e632b3cb-d12a-437e-a478-bee8b87fdf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:34.428056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 991/1973] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:34.432238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69edc24-dc32-48fb-b73b-61f6bf320b00 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.442514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69edc24-dc32-48fb-b73b-61f6bf320b00 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.448070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b12200-4f8c-4030-ace7-3aa226336759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.448750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b12200-4f8c-4030-ace7-3aa226336759 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.449032 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b12200-4f8c-4030-ace7-3aa226336759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.449307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b12200-4f8c-4030-ace7-3aa226336759 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.450072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b12200-4f8c-4030-ace7-3aa226336759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:34.450381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b12200-4f8c-4030-ace7-3aa226336759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.451977 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b12200-4f8c-4030-ace7-3aa226336759 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.465124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 983/1974] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:34.471033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632b3cb-d12a-437e-a478-bee8b87fdf20 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.481072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632b3cb-d12a-437e-a478-bee8b87fdf20 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.492175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6035346-27fc-46fa-9804-0a6f14eeb8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.493024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6035346-27fc-46fa-9804-0a6f14eeb8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.493314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6035346-27fc-46fa-9804-0a6f14eeb8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.493591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6035346-27fc-46fa-9804-0a6f14eeb8b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.494369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6035346-27fc-46fa-9804-0a6f14eeb8b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.496290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6035346-27fc-46fa-9804-0a6f14eeb8b6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.529919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 992/1975] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:34 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:34.532738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b12200-4f8c-4030-ace7-3aa226336759 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.544801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b12200-4f8c-4030-ace7-3aa226336759 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.607189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e228b0-4e79-4140-adc6-0a50b431feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.607935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e228b0-4e79-4140-adc6-0a50b431feb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.608216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e228b0-4e79-4140-adc6-0a50b431feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.608490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e228b0-4e79-4140-adc6-0a50b431feb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.609352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e228b0-4e79-4140-adc6-0a50b431feb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.612820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e228b0-4e79-4140-adc6-0a50b431feb7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.637805 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 984/1976] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:34 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:34.638945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6035346-27fc-46fa-9804-0a6f14eeb8b6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.650485 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6035346-27fc-46fa-9804-0a6f14eeb8b6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.668441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149cea0-fc9a-4f65-936b-6c283b687518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.669145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149cea0-fc9a-4f65-936b-6c283b687518 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.669418 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149cea0-fc9a-4f65-936b-6c283b687518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.669687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149cea0-fc9a-4f65-936b-6c283b687518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.670463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149cea0-fc9a-4f65-936b-6c283b687518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.672115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149cea0-fc9a-4f65-936b-6c283b687518 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.684812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 993/1977] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:34.689449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e228b0-4e79-4140-adc6-0a50b431feb7 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.699926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e228b0-4e79-4140-adc6-0a50b431feb7 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.707417 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c457244-f238-41e4-97c5-eb8fe8277ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.708104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457244-f238-41e4-97c5-eb8fe8277ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.708521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457244-f238-41e4-97c5-eb8fe8277ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.708690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457244-f238-41e4-97c5-eb8fe8277ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.709380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457244-f238-41e4-97c5-eb8fe8277ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.711184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457244-f238-41e4-97c5-eb8fe8277ad1 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.724129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 985/1978] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:34.728161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149cea0-fc9a-4f65-936b-6c283b687518 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.741484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149cea0-fc9a-4f65-936b-6c283b687518 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.749861 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c034c-5226-4853-b919-870f526e0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.750856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c034c-5226-4853-b919-870f526e0d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.751712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c034c-5226-4853-b919-870f526e0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.751712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c034c-5226-4853-b919-870f526e0d19 admin admin] PATH_INFO: `/v3/projects/2d5442b46ade4cef96182ac4df23b0bb/users/730439e875664a5a8eb0f4aa817226a7/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.772476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c034c-5226-4853-b919-870f526e0d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5442b46ade4cef96182ac4df23b0bb, user_id=730439e875664a5a8eb0f4aa817226a7, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.774968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c034c-5226-4853-b919-870f526e0d19 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.794829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 994/1979] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:34 2022] PUT /identity/v3/projects/2d5442b46ade4cef96182ac4df23b0bb/users/730439e875664a5a8eb0f4aa817226a7/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:34.805014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430719b-d01a-4c24-a715-ada61c3a0ba1 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.805310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430719b-d01a-4c24-a715-ada61c3a0ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.805591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430719b-d01a-4c24-a715-ada61c3a0ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.832250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d430719b-d01a-4c24-a715-ada61c3a0ba1 None None] MFA Rules not processed for user `730439e875664a5a8eb0f4aa817226a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:34.833510 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d430719b-d01a-4c24-a715-ada61c3a0ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:34.873175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:34.903807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 986/1980] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:34.909421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c034c-5226-4853-b919-870f526e0d19 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.975819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c034c-5226-4853-b919-870f526e0d19 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.981143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46f730-deb0-4152-92d3-b486fb311293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.981615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46f730-deb0-4152-92d3-b486fb311293 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.981968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46f730-deb0-4152-92d3-b486fb311293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.982251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46f730-deb0-4152-92d3-b486fb311293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.982990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46f730-deb0-4152-92d3-b486fb311293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.985305 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46f730-deb0-4152-92d3-b486fb311293 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.021231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 995/1981] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:34 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:35.025458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430719b-d01a-4c24-a715-ada61c3a0ba1 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.037780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430719b-d01a-4c24-a715-ada61c3a0ba1 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.100142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2af895-f2f4-4a92-90d3-a31a5bd2c267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.100828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af895-f2f4-4a92-90d3-a31a5bd2c267 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.101113 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af895-f2f4-4a92-90d3-a31a5bd2c267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.101389 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af895-f2f4-4a92-90d3-a31a5bd2c267 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.102125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2af895-f2f4-4a92-90d3-a31a5bd2c267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.104028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2af895-f2f4-4a92-90d3-a31a5bd2c267 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.130083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 987/1982] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:35.131482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46f730-deb0-4152-92d3-b486fb311293 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.143440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46f730-deb0-4152-92d3-b486fb311293 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.149111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c2139-fa7e-4ed7-a6a5-852e1c305cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.149806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2139-fa7e-4ed7-a6a5-852e1c305cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.150122 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2139-fa7e-4ed7-a6a5-852e1c305cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.150401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2139-fa7e-4ed7-a6a5-852e1c305cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.151132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c2139-fa7e-4ed7-a6a5-852e1c305cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.152723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c2139-fa7e-4ed7-a6a5-852e1c305cb6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.168592 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 996/1983] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:35.169446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2af895-f2f4-4a92-90d3-a31a5bd2c267 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.169577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c2139-fa7e-4ed7-a6a5-852e1c305cb6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.171342 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2b2af895-f2f4-4a92-90d3-a31a5bd2c267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:35.181421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c2139-fa7e-4ed7-a6a5-852e1c305cb6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.184798 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2af895-f2f4-4a92-90d3-a31a5bd2c267 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.186377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28868-5546-48e1-9567-1bd578947b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.187050 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28868-5546-48e1-9567-1bd578947b31 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.187329 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28868-5546-48e1-9567-1bd578947b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.187599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28868-5546-48e1-9567-1bd578947b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.188408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b28868-5546-48e1-9567-1bd578947b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.190167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb207e5-60ce-4378-a49a-7532ef4b3667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.190292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b28868-5546-48e1-9567-1bd578947b31 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.191351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb207e5-60ce-4378-a49a-7532ef4b3667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.191831 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb207e5-60ce-4378-a49a-7532ef4b3667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.192163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb207e5-60ce-4378-a49a-7532ef4b3667 admin admin] PATH_INFO: `/v3/users/1bae51656c3f47d487504c2a6a05f7b6` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.193576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb207e5-60ce-4378-a49a-7532ef4b3667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bae51656c3f47d487504c2a6a05f7b6)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.195560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb207e5-60ce-4378-a49a-7532ef4b3667 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.201476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 997/1984] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:35.206270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28868-5546-48e1-9567-1bd578947b31 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.219737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28868-5546-48e1-9567-1bd578947b31 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.224993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334fff1-7301-4b31-80d4-e0bd8394cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.225920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334fff1-7301-4b31-80d4-e0bd8394cc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.226187 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334fff1-7301-4b31-80d4-e0bd8394cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.226459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334fff1-7301-4b31-80d4-e0bd8394cc52 admin admin] PATH_INFO: `/v3/projects/366c70eb163a4e5da8989a43533057df/users/2594599f613746c89d5888298030aa89/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.243793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334fff1-7301-4b31-80d4-e0bd8394cc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=366c70eb163a4e5da8989a43533057df, user_id=2594599f613746c89d5888298030aa89, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.246613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334fff1-7301-4b31-80d4-e0bd8394cc52 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.253184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-bcb207e5-60ce-4378-a49a-7532ef4b3667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bae51656c3f47d487504c2a6a05f7b6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:35.262294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-bcb207e5-60ce-4378-a49a-7532ef4b3667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bae51656c3f47d487504c2a6a05f7b6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:35.263831 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 998/1985] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:35 2022] PUT /identity/v3/projects/366c70eb163a4e5da8989a43533057df/users/2594599f613746c89d5888298030aa89/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:35.274464 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f6bd-1c15-4088-830c-be4158e3ef28 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.274756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f6bd-1c15-4088-830c-be4158e3ef28 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.275035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f6bd-1c15-4088-830c-be4158e3ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.276018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-bcb207e5-60ce-4378-a49a-7532ef4b3667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bae51656c3f47d487504c2a6a05f7b6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:35.276807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-bcb207e5-60ce-4378-a49a-7532ef4b3667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bae51656c3f47d487504c2a6a05f7b6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:35.290431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-bcb207e5-60ce-4378-a49a-7532ef4b3667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bae51656c3f47d487504c2a6a05f7b6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:35.298343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 988/1986] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:35 2022] DELETE /identity/v3/users/1bae51656c3f47d487504c2a6a05f7b6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:35.302656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e23fc-d84b-4cb5-b926-55edaeb166bb None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.303242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e23fc-d84b-4cb5-b926-55edaeb166bb None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.303242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e23fc-d84b-4cb5-b926-55edaeb166bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.308480 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2ef0f6bd-1c15-4088-830c-be4158e3ef28 None None] MFA Rules not processed for user `2594599f613746c89d5888298030aa89`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:35.309692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2ef0f6bd-1c15-4088-830c-be4158e3ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:35.315846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:35.321572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3d1e23fc-d84b-4cb5-b926-55edaeb166bb None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:35.322812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3d1e23fc-d84b-4cb5-b926-55edaeb166bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:35.366181 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:35.385743 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 999/1987] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:35.391068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0f6bd-1c15-4088-830c-be4158e3ef28 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.393916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2ef0f6bd-1c15-4088-830c-be4158e3ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:35.402931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 989/1988] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:35.415359 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e23fc-d84b-4cb5-b926-55edaeb166bb None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.417048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3d1e23fc-d84b-4cb5-b926-55edaeb166bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:35.469977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0f6bd-1c15-4088-830c-be4158e3ef28 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.475385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb87f-ffff-4093-86c3-b747471e8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.476053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb87f-ffff-4093-86c3-b747471e8736 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.476792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb87f-ffff-4093-86c3-b747471e8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.476792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb87f-ffff-4093-86c3-b747471e8736 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.477273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceb87f-ffff-4093-86c3-b747471e8736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.479213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceb87f-ffff-4093-86c3-b747471e8736 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.487043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e23fc-d84b-4cb5-b926-55edaeb166bb None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.491895 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d72c9-7a67-42db-9e99-7252518c1c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.492670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d72c9-7a67-42db-9e99-7252518c1c44 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.492953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d72c9-7a67-42db-9e99-7252518c1c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.493227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d72c9-7a67-42db-9e99-7252518c1c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.507387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d72c9-7a67-42db-9e99-7252518c1c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.508832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d72c9-7a67-42db-9e99-7252518c1c44 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.514523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1000/1989] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:35.515367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb87f-ffff-4093-86c3-b747471e8736 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.521216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 990/1990] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:35.616062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb87f-ffff-4093-86c3-b747471e8736 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.627513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bbb57-ae1e-453f-afe9-a1a8c4c2afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.628320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bbb57-ae1e-453f-afe9-a1a8c4c2afbc admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.629137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bbb57-ae1e-453f-afe9-a1a8c4c2afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.629660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bbb57-ae1e-453f-afe9-a1a8c4c2afbc admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.630507 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bbb57-ae1e-453f-afe9-a1a8c4c2afbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.632623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bbb57-ae1e-453f-afe9-a1a8c4c2afbc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.667856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1001/1991] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:35.671965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d72c9-7a67-42db-9e99-7252518c1c44 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.696477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d72c9-7a67-42db-9e99-7252518c1c44 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.703931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaab41-3657-47e4-8ca4-3871e7bd8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.705313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaab41-3657-47e4-8ca4-3871e7bd8952 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.705584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaab41-3657-47e4-8ca4-3871e7bd8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.705859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaab41-3657-47e4-8ca4-3871e7bd8952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.706643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaab41-3657-47e4-8ca4-3871e7bd8952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.708321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaab41-3657-47e4-8ca4-3871e7bd8952 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.719822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 991/1992] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:35.724451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bbb57-ae1e-453f-afe9-a1a8c4c2afbc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.736204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bbb57-ae1e-453f-afe9-a1a8c4c2afbc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.742706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249de793-f0a6-47f3-9e6a-18f376ed0f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.743761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de793-f0a6-47f3-9e6a-18f376ed0f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.744177 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de793-f0a6-47f3-9e6a-18f376ed0f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.744905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de793-f0a6-47f3-9e6a-18f376ed0f20 admin admin] PATH_INFO: `/v3/projects/9d707f910dd34370867edc71e89d34ee/users/922f050a4c9343eda253f1a6181478a7/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.764663 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249de793-f0a6-47f3-9e6a-18f376ed0f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d707f910dd34370867edc71e89d34ee, user_id=922f050a4c9343eda253f1a6181478a7, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.767562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249de793-f0a6-47f3-9e6a-18f376ed0f20 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.771105 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:35.785593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1002/1993] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:35 2022] PUT /identity/v3/projects/9d707f910dd34370867edc71e89d34ee/users/922f050a4c9343eda253f1a6181478a7/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:35.791264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaab41-3657-47e4-8ca4-3871e7bd8952 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.805578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaab41-3657-47e4-8ca4-3871e7bd8952 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.857124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249de793-f0a6-47f3-9e6a-18f376ed0f20 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.858933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-249de793-f0a6-47f3-9e6a-18f376ed0f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:35.905337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e066f9-a533-4001-9b31-26dba8c164ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.906095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e066f9-a533-4001-9b31-26dba8c164ee admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.906370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e066f9-a533-4001-9b31-26dba8c164ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.906650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e066f9-a533-4001-9b31-26dba8c164ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.908223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e066f9-a533-4001-9b31-26dba8c164ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.909844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e066f9-a533-4001-9b31-26dba8c164ee admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.921084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 992/1994] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:35.925109 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e066f9-a533-4001-9b31-26dba8c164ee admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.935773 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e066f9-a533-4001-9b31-26dba8c164ee admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.942552 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b564e-37b2-4d26-ab36-e5cf03d3d0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.943474 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b564e-37b2-4d26-ab36-e5cf03d3d0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.943761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b564e-37b2-4d26-ab36-e5cf03d3d0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.944043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b564e-37b2-4d26-ab36-e5cf03d3d0e5 admin admin] PATH_INFO: `/v3/projects/9d707f910dd34370867edc71e89d34ee/users/922f050a4c9343eda253f1a6181478a7/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.946192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b564e-37b2-4d26-ab36-e5cf03d3d0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d707f910dd34370867edc71e89d34ee, user_id=922f050a4c9343eda253f1a6181478a7, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.949106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b564e-37b2-4d26-ab36-e5cf03d3d0e5 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.951893 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249de793-f0a6-47f3-9e6a-18f376ed0f20 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.957329 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.958262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.958545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.958819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] PATH_INFO: `/v3/projects/d78e633127494721b30fdbf4acc578b7` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.960125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d78e633127494721b30fdbf4acc578b7)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.962316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.962431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 993/1995] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:35 2022] PUT /identity/v3/projects/9d707f910dd34370867edc71e89d34ee/users/922f050a4c9343eda253f1a6181478a7/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:35.973778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be633cf7-3c6c-4890-855b-72ee0b907ca9 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.974208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be633cf7-3c6c-4890-855b-72ee0b907ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.974492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be633cf7-3c6c-4890-855b-72ee0b907ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.008013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-be633cf7-3c6c-4890-855b-72ee0b907ca9 None None] MFA Rules not processed for user `922f050a4c9343eda253f1a6181478a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:36.009293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-be633cf7-3c6c-4890-855b-72ee0b907ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.013867 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd78e633127494721b30fdbf4acc578b7', 'request_id': 'req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.023770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd78e633127494721b30fdbf4acc578b7', 'request_id': 'req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.030762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd78e633127494721b30fdbf4acc578b7', 'request_id': 'req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.042211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] The token cache is being invalidate because project d78e633127494721b30fdbf4acc578b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:36.042503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.043157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.044728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1003/1996] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:35 2022] DELETE /identity/v3/projects/d78e633127494721b30fdbf4acc578b7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:36.049100 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.050460 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.058457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:36.088258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 994/1997] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:36.100069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be633cf7-3c6c-4890-855b-72ee0b907ca9 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.101738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-be633cf7-3c6c-4890-855b-72ee0b907ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.137849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0d8d4-31d5-491f-ad46-8d4aadc88c56 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.144900 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd8cb2-6a5f-478e-8585-624eaa37638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.145791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd8cb2-6a5f-478e-8585-624eaa37638f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.146124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd8cb2-6a5f-478e-8585-624eaa37638f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.146405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd8cb2-6a5f-478e-8585-624eaa37638f admin admin] PATH_INFO: `/v3/users/4666b44532f34fcb9bf5893087d5652c` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.147642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd8cb2-6a5f-478e-8585-624eaa37638f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4666b44532f34fcb9bf5893087d5652c)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:36.150216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd8cb2-6a5f-478e-8585-624eaa37638f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:36.169144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be633cf7-3c6c-4890-855b-72ee0b907ca9 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.173914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ec4c1-0b95-4dab-96f4-4da8b4ad759d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.174517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec4c1-0b95-4dab-96f4-4da8b4ad759d service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.174798 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec4c1-0b95-4dab-96f4-4da8b4ad759d service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.175104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec4c1-0b95-4dab-96f4-4da8b4ad759d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.183162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:36.185920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ec4c1-0b95-4dab-96f4-4da8b4ad759d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:36.187626 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ec4c1-0b95-4dab-96f4-4da8b4ad759d service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:36.201029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 995/1998] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:36.209413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9cbd8cb2-6a5f-478e-8585-624eaa37638f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4666b44532f34fcb9bf5893087d5652c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.210123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9cbd8cb2-6a5f-478e-8585-624eaa37638f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4666b44532f34fcb9bf5893087d5652c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.211139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9cbd8cb2-6a5f-478e-8585-624eaa37638f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4666b44532f34fcb9bf5893087d5652c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.229506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9cbd8cb2-6a5f-478e-8585-624eaa37638f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4666b44532f34fcb9bf5893087d5652c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.239537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9cbd8cb2-6a5f-478e-8585-624eaa37638f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4666b44532f34fcb9bf5893087d5652c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.262766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1004/1999] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:36 2022] DELETE /identity/v3/users/4666b44532f34fcb9bf5893087d5652c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:36.682991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ec4c1-0b95-4dab-96f4-4da8b4ad759d service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.707962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ec4c1-0b95-4dab-96f4-4da8b4ad759d service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.778678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.779553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.779837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.780115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] PATH_INFO: `/v3/projects/58d7d5bc5e4e482cb9f6b12575b59032` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.781374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d7d5bc5e4e482cb9f6b12575b59032)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:36.783635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:36.859219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d7d5bc5e4e482cb9f6b12575b59032', 'request_id': 'req-2aaa0354-1c2c-4582-97bf-68a070689530'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.872297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d7d5bc5e4e482cb9f6b12575b59032', 'request_id': 'req-2aaa0354-1c2c-4582-97bf-68a070689530'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.886050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d7d5bc5e4e482cb9f6b12575b59032', 'request_id': 'req-2aaa0354-1c2c-4582-97bf-68a070689530'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.902411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] The token cache is being invalidate because project 58d7d5bc5e4e482cb9f6b12575b59032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:36.902743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.903467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:36.905062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 996/2000] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:36 2022] DELETE /identity/v3/projects/58d7d5bc5e4e482cb9f6b12575b59032 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:36.910813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f947d-61b9-46e3-bfff-e969f72eb80c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.911303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f947d-61b9-46e3-bfff-e969f72eb80c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.911634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f947d-61b9-46e3-bfff-e969f72eb80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.930296 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3d6f947d-61b9-46e3-bfff-e969f72eb80c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:36.931593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3d6f947d-61b9-46e3-bfff-e969f72eb80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.969960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.972114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.995174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:37.041590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1005/2001] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:37.052453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84937-fa83-4375-9cb4-4c4f59d66651 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.053173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84937-fa83-4375-9cb4-4c4f59d66651 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.053593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84937-fa83-4375-9cb4-4c4f59d66651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.068266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa0354-1c2c-4582-97bf-68a070689530 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:37.072997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef159340-76bc-440d-953e-12e01cbd1430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.073257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef159340-76bc-440d-953e-12e01cbd1430 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.073545 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef159340-76bc-440d-953e-12e01cbd1430 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.073822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef159340-76bc-440d-953e-12e01cbd1430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.075170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f9c84937-fa83-4375-9cb4-4c4f59d66651 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:37.075717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ef159340-76bc-440d-953e-12e01cbd1430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:37.076495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f9c84937-fa83-4375-9cb4-4c4f59d66651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:37.086087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1006/2002] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:37.090275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c84937-fa83-4375-9cb4-4c4f59d66651 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:37.102886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c84937-fa83-4375-9cb4-4c4f59d66651 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:37.109691 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e683b-374c-4f2a-9355-c6cc022a746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.112816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e683b-374c-4f2a-9355-c6cc022a746b admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.113248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e683b-374c-4f2a-9355-c6cc022a746b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.113945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e683b-374c-4f2a-9355-c6cc022a746b admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.115596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e683b-374c-4f2a-9355-c6cc022a746b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:37.116157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e683b-374c-4f2a-9355-c6cc022a746b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.118245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e683b-374c-4f2a-9355-c6cc022a746b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.132562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1007/2003] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:37.138864 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e683b-374c-4f2a-9355-c6cc022a746b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:37.146806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef159340-76bc-440d-953e-12e01cbd1430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.148578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef159340-76bc-440d-953e-12e01cbd1430 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.151302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e683b-374c-4f2a-9355-c6cc022a746b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:37.156761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477bdfb-e85b-4699-a5b2-047d61a1af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.157738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477bdfb-e85b-4699-a5b2-047d61a1af0a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.158273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477bdfb-e85b-4699-a5b2-047d61a1af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.158630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477bdfb-e85b-4699-a5b2-047d61a1af0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.159443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477bdfb-e85b-4699-a5b2-047d61a1af0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.160198 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 997/2004] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:37.161648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477bdfb-e85b-4699-a5b2-047d61a1af0a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.201926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1008/2005] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:37 2022] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:37.204457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef159340-76bc-440d-953e-12e01cbd1430 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:37.216457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef159340-76bc-440d-953e-12e01cbd1430 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:37.293805 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7f18-6790-4ed1-897b-a5a2a5714b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.294688 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7f18-6790-4ed1-897b-a5a2a5714b1f admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.294979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7f18-6790-4ed1-897b-a5a2a5714b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.295258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7f18-6790-4ed1-897b-a5a2a5714b1f admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.296283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc7f18-6790-4ed1-897b-a5a2a5714b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.300227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc7f18-6790-4ed1-897b-a5a2a5714b1f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.335679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 998/2006] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:37 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:37.340660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477bdfb-e85b-4699-a5b2-047d61a1af0a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:37.352489 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477bdfb-e85b-4699-a5b2-047d61a1af0a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:37.371326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd145b9-719e-4dda-a58a-ea2656293164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.372018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd145b9-719e-4dda-a58a-ea2656293164 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.372353 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd145b9-719e-4dda-a58a-ea2656293164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.372772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd145b9-719e-4dda-a58a-ea2656293164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.374762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd145b9-719e-4dda-a58a-ea2656293164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.377408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd145b9-719e-4dda-a58a-ea2656293164 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.403364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1009/2007] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:37.404506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7f18-6790-4ed1-897b-a5a2a5714b1f admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:37.420730 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7f18-6790-4ed1-897b-a5a2a5714b1f admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:37.427546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06db31-733e-4899-858a-869252c5d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.428800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06db31-733e-4899-858a-869252c5d459 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.429553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06db31-733e-4899-858a-869252c5d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.429840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06db31-733e-4899-858a-869252c5d459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.430629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06db31-733e-4899-858a-869252c5d459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.432476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06db31-733e-4899-858a-869252c5d459 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.458113 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 999/2008] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:37.462143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd145b9-719e-4dda-a58a-ea2656293164 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:37.479271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd145b9-719e-4dda-a58a-ea2656293164 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:37.484804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf9c0a-c984-4363-802c-a423648905f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.486351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf9c0a-c984-4363-802c-a423648905f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.486734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf9c0a-c984-4363-802c-a423648905f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.486994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf9c0a-c984-4363-802c-a423648905f9 admin admin] PATH_INFO: `/v3/projects/59aca9d324154432858553ecec10e566/users/021f36759e2f4cc99af8f4e55ee15075/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.507131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf9c0a-c984-4363-802c-a423648905f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59aca9d324154432858553ecec10e566, user_id=021f36759e2f4cc99af8f4e55ee15075, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.511443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf9c0a-c984-4363-802c-a423648905f9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.551982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1010/2009] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:37 2022] PUT /identity/v3/projects/59aca9d324154432858553ecec10e566/users/021f36759e2f4cc99af8f4e55ee15075/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:37.567860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbf87a-3d4f-4ece-b72d-177bb8326d91 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.568146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbf87a-3d4f-4ece-b72d-177bb8326d91 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.568447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbf87a-3d4f-4ece-b72d-177bb8326d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.605345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c6bbf87a-3d4f-4ece-b72d-177bb8326d91 None None] MFA Rules not processed for user `021f36759e2f4cc99af8f4e55ee15075`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:37.606612 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c6bbf87a-3d4f-4ece-b72d-177bb8326d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:37.647703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:37.692457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1000/2010] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:37.705099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf9c0a-c984-4363-802c-a423648905f9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:37.744417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:37.798336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf9c0a-c984-4363-802c-a423648905f9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:37.802185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad76eba-5801-401d-ba17-7823bc654f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.802840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad76eba-5801-401d-ba17-7823bc654f13 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.803125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad76eba-5801-401d-ba17-7823bc654f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.803401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad76eba-5801-401d-ba17-7823bc654f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.813991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad76eba-5801-401d-ba17-7823bc654f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.815454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad76eba-5801-401d-ba17-7823bc654f13 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.834057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1011/2011] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:42.754300 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbf87a-3d4f-4ece-b72d-177bb8326d91 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:42.756277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c6bbf87a-3d4f-4ece-b72d-177bb8326d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:42.772061 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbf87a-3d4f-4ece-b72d-177bb8326d91 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:42.783327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb1999-f9d4-4837-b9bc-cb9649dfe6e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:42.783940 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb1999-f9d4-4837-b9bc-cb9649dfe6e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:42.784313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb1999-f9d4-4837-b9bc-cb9649dfe6e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:42.784723 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb1999-f9d4-4837-b9bc-cb9649dfe6e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:42.786697 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-16bb1999-f9d4-4837-b9bc-cb9649dfe6e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:42.853343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb1999-f9d4-4837-b9bc-cb9649dfe6e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:42.854834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb1999-f9d4-4837-b9bc-cb9649dfe6e8 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:42.866686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1001/2012] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:45.184741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad76eba-5801-401d-ba17-7823bc654f13 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:45.186156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6ad76eba-5801-401d-ba17-7823bc654f13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:45.254526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad76eba-5801-401d-ba17-7823bc654f13 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:45.259070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:45.259950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:45.260234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:45.260511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] PATH_INFO: `/v3/users/730439e875664a5a8eb0f4aa817226a7` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:45.261706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=730439e875664a5a8eb0f4aa817226a7)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:45.263666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:45.313853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '730439e875664a5a8eb0f4aa817226a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.314581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '730439e875664a5a8eb0f4aa817226a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.315225 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '730439e875664a5a8eb0f4aa817226a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.322437 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '730439e875664a5a8eb0f4aa817226a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.331476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '730439e875664a5a8eb0f4aa817226a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.348652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1012/2013] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:45 2022] DELETE /identity/v3/users/730439e875664a5a8eb0f4aa817226a7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:45.353237 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbe8f9-2ddc-4699-ab40-e354e1a8d25b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:45.353704 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbe8f9-2ddc-4699-ab40-e354e1a8d25b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:45.353835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbe8f9-2ddc-4699-ab40-e354e1a8d25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:45.373481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-43bbe8f9-2ddc-4699-ab40-e354e1a8d25b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:45.374808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-43bbe8f9-2ddc-4699-ab40-e354e1a8d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:45.463100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1002/2014] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:45.473713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:45.475204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:45.540325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507d258-84be-4a83-b831-2b0ba1f3aa1b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:45.544216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bd0c3-4505-49de-8e5e-93f316d71f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:45.544927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd0c3-4505-49de-8e5e-93f316d71f5b service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:45.545235 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd0c3-4505-49de-8e5e-93f316d71f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:45.545538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd0c3-4505-49de-8e5e-93f316d71f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:45.553243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:45.559057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bd0c3-4505-49de-8e5e-93f316d71f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:45.561329 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bd0c3-4505-49de-8e5e-93f316d71f5b service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:45.573190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1013/2015] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:45.883780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbe8f9-2ddc-4699-ab40-e354e1a8d25b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:45.885317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-43bbe8f9-2ddc-4699-ab40-e354e1a8d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:45.898506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbe8f9-2ddc-4699-ab40-e354e1a8d25b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:45.903874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:45.905705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:45.906034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:45.906360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] PATH_INFO: `/v3/projects/2d5442b46ade4cef96182ac4df23b0bb` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:45.909253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5442b46ade4cef96182ac4df23b0bb)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:45.911508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:45.965820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5442b46ade4cef96182ac4df23b0bb', 'request_id': 'req-81862837-35af-407c-a507-2e667ca99673'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.986879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5442b46ade4cef96182ac4df23b0bb', 'request_id': 'req-81862837-35af-407c-a507-2e667ca99673'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.994605 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5442b46ade4cef96182ac4df23b0bb', 'request_id': 'req-81862837-35af-407c-a507-2e667ca99673'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.002370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:46.007953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] The token cache is being invalidate because project 2d5442b46ade4cef96182ac4df23b0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:46.008248 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.009132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.011746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1003/2016] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:45 2022] DELETE /identity/v3/projects/2d5442b46ade4cef96182ac4df23b0bb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:46.019094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bd0c3-4505-49de-8e5e-93f316d71f5b service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:46.028823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bd0c3-4505-49de-8e5e-93f316d71f5b service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:46.084804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:46.085777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:46.086097 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:46.086378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] PATH_INFO: `/v3/users/2594599f613746c89d5888298030aa89` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:46.087719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2594599f613746c89d5888298030aa89)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:46.089665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:46.139411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2594599f613746c89d5888298030aa89'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.140099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2594599f613746c89d5888298030aa89'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.140768 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2594599f613746c89d5888298030aa89'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.148847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2594599f613746c89d5888298030aa89'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.157083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2594599f613746c89d5888298030aa89'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.177530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1014/2017] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:46 2022] DELETE /identity/v3/users/2594599f613746c89d5888298030aa89 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:46.546777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:46.548380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:46.562088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862837-35af-407c-a507-2e667ca99673 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:46.634112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:46.635023 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:46.635303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:46.635576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] PATH_INFO: `/v3/projects/366c70eb163a4e5da8989a43533057df` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:46.637032 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=366c70eb163a4e5da8989a43533057df)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:46.639906 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:46.692480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366c70eb163a4e5da8989a43533057df', 'request_id': 'req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.700081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366c70eb163a4e5da8989a43533057df', 'request_id': 'req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.707411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366c70eb163a4e5da8989a43533057df', 'request_id': 'req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.720763 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] The token cache is being invalidate because project 366c70eb163a4e5da8989a43533057df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:46.721058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.721726 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.723415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1004/2018] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:46 2022] DELETE /identity/v3/projects/366c70eb163a4e5da8989a43533057df => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:46.727286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:46.728720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:46.742278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e658a-c9bf-40ea-ac23-c32d8f7c4cd0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:46.802443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:46.803349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:46.803637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:46.803911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] PATH_INFO: `/v3/users/922f050a4c9343eda253f1a6181478a7` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:46.805120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=922f050a4c9343eda253f1a6181478a7)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:46.807067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:46.822782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:46.858784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922f050a4c9343eda253f1a6181478a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.859520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922f050a4c9343eda253f1a6181478a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.860191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922f050a4c9343eda253f1a6181478a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.867589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922f050a4c9343eda253f1a6181478a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.876522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922f050a4c9343eda253f1a6181478a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.895665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1015/2019] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:46 2022] DELETE /identity/v3/users/922f050a4c9343eda253f1a6181478a7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:47.183419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:47.185817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:47.202447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9f7cc-adcf-4300-8bef-a8dce91abf0f admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:47.269430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:47.270335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:47.270620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:47.270895 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] PATH_INFO: `/v3/projects/9d707f910dd34370867edc71e89d34ee` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:47.272097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d707f910dd34370867edc71e89d34ee)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:47.274516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:47.315419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:47.331057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d707f910dd34370867edc71e89d34ee', 'request_id': 'req-9ccfaeb8-376d-43e3-b6a1-404c40334a13'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:47.339033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d707f910dd34370867edc71e89d34ee', 'request_id': 'req-9ccfaeb8-376d-43e3-b6a1-404c40334a13'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:47.346082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d707f910dd34370867edc71e89d34ee', 'request_id': 'req-9ccfaeb8-376d-43e3-b6a1-404c40334a13'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:47.358129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] The token cache is being invalidate because project 9d707f910dd34370867edc71e89d34ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:47.358421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:47.359097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9ccfaeb8-376d-43e3-b6a1-404c40334a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:47.361982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1005/2020] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:47 2022] DELETE /identity/v3/projects/9d707f910dd34370867edc71e89d34ee => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:49.081979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:49.083473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:49.096786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010feb01-7729-43b3-bf81-372ced1ce486 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:49.156956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:49.157487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.157804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.158083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] PATH_INFO: `/v3/users/021f36759e2f4cc99af8f4e55ee15075` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.159300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=021f36759e2f4cc99af8f4e55ee15075)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:49.161221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:49.214127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '021f36759e2f4cc99af8f4e55ee15075'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.215012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '021f36759e2f4cc99af8f4e55ee15075'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.215924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '021f36759e2f4cc99af8f4e55ee15075'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.224737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '021f36759e2f4cc99af8f4e55ee15075'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.232288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '021f36759e2f4cc99af8f4e55ee15075'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.258849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1016/2021] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:49 2022] DELETE /identity/v3/users/021f36759e2f4cc99af8f4e55ee15075 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:49.263231 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6d227-427d-4451-baef-338957e3fec2 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.263725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6d227-427d-4451-baef-338957e3fec2 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.263820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6d227-427d-4451-baef-338957e3fec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.284063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d2f6d227-427d-4451-baef-338957e3fec2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:49.285323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d2f6d227-427d-4451-baef-338957e3fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:49.351803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1006/2022] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:49.362442 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:49.363972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:49.380506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:49.438356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd47f59-0874-4ee6-86f5-f8e04206b319 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:49.442407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f943413-c0d0-457c-aa20-84cd604d980b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:49.443250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943413-c0d0-457c-aa20-84cd604d980b service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.443693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943413-c0d0-457c-aa20-84cd604d980b service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.444258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943413-c0d0-457c-aa20-84cd604d980b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.456474 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f943413-c0d0-457c-aa20-84cd604d980b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:49.457963 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f943413-c0d0-457c-aa20-84cd604d980b service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:49.468285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1017/2023] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:49.818409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6d227-427d-4451-baef-338957e3fec2 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:49.820585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d2f6d227-427d-4451-baef-338957e3fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:49.843039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6d227-427d-4451-baef-338957e3fec2 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:49.851597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:49.853123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.853567 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.854240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] PATH_INFO: `/v3/projects/59aca9d324154432858553ecec10e566` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.856026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59aca9d324154432858553ecec10e566)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:49.860288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:49.941196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59aca9d324154432858553ecec10e566', 'request_id': 'req-7d96b64f-1ec2-46ac-b871-53bd66bedc67'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.953414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59aca9d324154432858553ecec10e566', 'request_id': 'req-7d96b64f-1ec2-46ac-b871-53bd66bedc67'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.963251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59aca9d324154432858553ecec10e566', 'request_id': 'req-7d96b64f-1ec2-46ac-b871-53bd66bedc67'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.974818 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] The token cache is being invalidate because project 59aca9d324154432858553ecec10e566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:49.975194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.975918 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7d96b64f-1ec2-46ac-b871-53bd66bedc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.977775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1007/2024] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:49 2022] DELETE /identity/v3/projects/59aca9d324154432858553ecec10e566 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:49.982481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fd758-fd0e-4b78-a386-73d662bce594 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.982864 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fd758-fd0e-4b78-a386-73d662bce594 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.983214 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fd758-fd0e-4b78-a386-73d662bce594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.003246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2f8fd758-fd0e-4b78-a386-73d662bce594 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:50.004618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2f8fd758-fd0e-4b78-a386-73d662bce594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:50.087570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1018/2025] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:50.095352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64db75-a8b1-4145-977e-616cf6cf2881 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.095879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64db75-a8b1-4145-977e-616cf6cf2881 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.096161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64db75-a8b1-4145-977e-616cf6cf2881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.120654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-8e64db75-a8b1-4145-977e-616cf6cf2881 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:50.122096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8e64db75-a8b1-4145-977e-616cf6cf2881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:50.130635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1008/2026] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:50.134876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fd758-fd0e-4b78-a386-73d662bce594 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.150773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fd758-fd0e-4b78-a386-73d662bce594 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.155378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7c5e3-1c29-44c1-a3be-32ed107a39ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.156045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7c5e3-1c29-44c1-a3be-32ed107a39ac admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.157008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7c5e3-1c29-44c1-a3be-32ed107a39ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.157334 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7c5e3-1c29-44c1-a3be-32ed107a39ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.158213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7c5e3-1c29-44c1-a3be-32ed107a39ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:50.158546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7c5e3-1c29-44c1-a3be-32ed107a39ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.160146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7c5e3-1c29-44c1-a3be-32ed107a39ac admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.176341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1019/2027] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:50.178068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64db75-a8b1-4145-977e-616cf6cf2881 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.187888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64db75-a8b1-4145-977e-616cf6cf2881 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.192469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b538ae-86f5-407e-a6f0-eb07b3a852e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.193225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b538ae-86f5-407e-a6f0-eb07b3a852e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.193573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b538ae-86f5-407e-a6f0-eb07b3a852e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.193949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b538ae-86f5-407e-a6f0-eb07b3a852e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.194756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b538ae-86f5-407e-a6f0-eb07b3a852e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.196950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b538ae-86f5-407e-a6f0-eb07b3a852e8 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.230724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1009/2028] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:50 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:50.235550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7c5e3-1c29-44c1-a3be-32ed107a39ac admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.246077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7c5e3-1c29-44c1-a3be-32ed107a39ac admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.320047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409460-fb96-475f-b48a-7a8d215bfe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.320857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409460-fb96-475f-b48a-7a8d215bfe4a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.321207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409460-fb96-475f-b48a-7a8d215bfe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.321555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409460-fb96-475f-b48a-7a8d215bfe4a admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.322412 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b409460-fb96-475f-b48a-7a8d215bfe4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.324343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b409460-fb96-475f-b48a-7a8d215bfe4a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.349352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1020/2029] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:50 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:50.350623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b538ae-86f5-407e-a6f0-eb07b3a852e8 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.363109 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b538ae-86f5-407e-a6f0-eb07b3a852e8 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.368985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f8865-6fdc-4c5a-a900-96fa0a432444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.369790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f8865-6fdc-4c5a-a900-96fa0a432444 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.370051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f8865-6fdc-4c5a-a900-96fa0a432444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.370331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f8865-6fdc-4c5a-a900-96fa0a432444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.371066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f8865-6fdc-4c5a-a900-96fa0a432444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.372771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f8865-6fdc-4c5a-a900-96fa0a432444 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.387432 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1010/2030] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:50.391827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409460-fb96-475f-b48a-7a8d215bfe4a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.405383 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409460-fb96-475f-b48a-7a8d215bfe4a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.410746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c9173-1ab0-44bf-8503-4e026d1a4ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.411507 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c9173-1ab0-44bf-8503-4e026d1a4ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.411868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c9173-1ab0-44bf-8503-4e026d1a4ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.412218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c9173-1ab0-44bf-8503-4e026d1a4ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.413358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c9173-1ab0-44bf-8503-4e026d1a4ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.414845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c9173-1ab0-44bf-8503-4e026d1a4ca2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.430394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1021/2031] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:50.432161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f8865-6fdc-4c5a-a900-96fa0a432444 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.438162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:50.447196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f8865-6fdc-4c5a-a900-96fa0a432444 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.454942 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9647-acaf-4a88-8b68-3eb186ffde76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.455946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9647-acaf-4a88-8b68-3eb186ffde76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.456276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9647-acaf-4a88-8b68-3eb186ffde76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.456585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9647-acaf-4a88-8b68-3eb186ffde76 admin admin] PATH_INFO: `/v3/projects/bfc214b663204d56b1218b494b5a7643/users/69fe4af4381044df9f22cc9b1a5f437b/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.472783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d9647-acaf-4a88-8b68-3eb186ffde76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc214b663204d56b1218b494b5a7643, user_id=69fe4af4381044df9f22cc9b1a5f437b, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.475691 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d9647-acaf-4a88-8b68-3eb186ffde76 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.491360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1011/2032] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:50 2022] PUT /identity/v3/projects/bfc214b663204d56b1218b494b5a7643/users/69fe4af4381044df9f22cc9b1a5f437b/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:50.502778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec346a4-1485-4327-af61-8475c94f8dc5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.503098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec346a4-1485-4327-af61-8475c94f8dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.503410 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec346a4-1485-4327-af61-8475c94f8dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.531830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cec346a4-1485-4327-af61-8475c94f8dc5 None None] MFA Rules not processed for user `69fe4af4381044df9f22cc9b1a5f437b`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:50.533081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cec346a4-1485-4327-af61-8475c94f8dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:50.541529 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:50.621047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1022/2033] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:50.630019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9647-acaf-4a88-8b68-3eb186ffde76 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.631778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-781d9647-acaf-4a88-8b68-3eb186ffde76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:50.733280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9647-acaf-4a88-8b68-3eb186ffde76 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.743258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca8c49-9e13-404a-839a-02208c7c8b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.743939 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca8c49-9e13-404a-839a-02208c7c8b77 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.744225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca8c49-9e13-404a-839a-02208c7c8b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.744502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca8c49-9e13-404a-839a-02208c7c8b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.763642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca8c49-9e13-404a-839a-02208c7c8b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.766306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca8c49-9e13-404a-839a-02208c7c8b77 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.784893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1012/2034] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:55.697714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec346a4-1485-4327-af61-8475c94f8dc5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:55.699213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cec346a4-1485-4327-af61-8475c94f8dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:55.711843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec346a4-1485-4327-af61-8475c94f8dc5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:55.715503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a24bf-b6c1-43bc-8dc2-cfde162d6558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:55.716162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a24bf-b6c1-43bc-8dc2-cfde162d6558 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:55.716484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a24bf-b6c1-43bc-8dc2-cfde162d6558 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:55.716814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a24bf-b6c1-43bc-8dc2-cfde162d6558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:55.719109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f46a24bf-b6c1-43bc-8dc2-cfde162d6558 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:55.787883 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a24bf-b6c1-43bc-8dc2-cfde162d6558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:55.789447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a24bf-b6c1-43bc-8dc2-cfde162d6558 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:55.800074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1023/2035] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:57.063426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca8c49-9e13-404a-839a-02208c7c8b77 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:57.132041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca8c49-9e13-404a-839a-02208c7c8b77 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:57.136627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:57.137506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:57.137790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:57.138122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] PATH_INFO: `/v3/users/69fe4af4381044df9f22cc9b1a5f437b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:57.139577 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fe4af4381044df9f22cc9b1a5f437b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:57.142144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:57.193969 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fe4af4381044df9f22cc9b1a5f437b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.200985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fe4af4381044df9f22cc9b1a5f437b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.214685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fe4af4381044df9f22cc9b1a5f437b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.215388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fe4af4381044df9f22cc9b1a5f437b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.223800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fe4af4381044df9f22cc9b1a5f437b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.226254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:57.231034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1013/2036] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:57 2022] DELETE /identity/v3/users/69fe4af4381044df9f22cc9b1a5f437b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:57.235996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff44be-f69f-431e-a47e-dc976d3cf89b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:57.236502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff44be-f69f-431e-a47e-dc976d3cf89b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:57.236600 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff44be-f69f-431e-a47e-dc976d3cf89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:57.257400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e9ff44be-f69f-431e-a47e-dc976d3cf89b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:57.258727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e9ff44be-f69f-431e-a47e-dc976d3cf89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:57.319224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1024/2037] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:57.329795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:57.331277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:57.389564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe32e16-6b63-4a12-97f6-6e32e469d8fe admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:57.394333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ffa41-1878-4dae-b1bb-466671ccdcaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:57.394990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ffa41-1878-4dae-b1bb-466671ccdcaf service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:57.395273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ffa41-1878-4dae-b1bb-466671ccdcaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:57.395576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ffa41-1878-4dae-b1bb-466671ccdcaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:57.404786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ffa41-1878-4dae-b1bb-466671ccdcaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:57.406914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ffa41-1878-4dae-b1bb-466671ccdcaf service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:57.416540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1014/2038] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:57.690389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff44be-f69f-431e-a47e-dc976d3cf89b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:57.691888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e9ff44be-f69f-431e-a47e-dc976d3cf89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:57.710849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff44be-f69f-431e-a47e-dc976d3cf89b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:57.717318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:57.718449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:57.719211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:57.719413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] PATH_INFO: `/v3/projects/bfc214b663204d56b1218b494b5a7643` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:57.720735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc214b663204d56b1218b494b5a7643)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:57.722769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:57.769120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:57.779130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc214b663204d56b1218b494b5a7643', 'request_id': 'req-90c82ebc-cf38-4df3-8fac-41bec28c4491'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.788659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc214b663204d56b1218b494b5a7643', 'request_id': 'req-90c82ebc-cf38-4df3-8fac-41bec28c4491'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.795877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc214b663204d56b1218b494b5a7643', 'request_id': 'req-90c82ebc-cf38-4df3-8fac-41bec28c4491'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.807903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] The token cache is being invalidate because project bfc214b663204d56b1218b494b5a7643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:57.808196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.808869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.810471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1025/2039] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:57 2022] DELETE /identity/v3/projects/bfc214b663204d56b1218b494b5a7643 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:07.412226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=26 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:07.804625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:14.649587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ffa41-1878-4dae-b1bb-466671ccdcaf service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:14.651146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-485ffa41-1878-4dae-b1bb-466671ccdcaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:14.739482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ffa41-1878-4dae-b1bb-466671ccdcaf service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:14.800223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6e15e-ea8c-4131-af58-41250c0ce40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:14.801116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6e15e-ea8c-4131-af58-41250c0ce40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.801398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6e15e-ea8c-4131-af58-41250c0ce40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.801670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6e15e-ea8c-4131-af58-41250c0ce40b admin admin] PATH_INFO: `/v3/users/84263576aaec455a91b6035cc5dca4ff` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.802953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6e15e-ea8c-4131-af58-41250c0ce40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84263576aaec455a91b6035cc5dca4ff)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:14.804915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6e15e-ea8c-4131-af58-41250c0ce40b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:14.853131 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-49d6e15e-ea8c-4131-af58-41250c0ce40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84263576aaec455a91b6035cc5dca4ff'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.861437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-49d6e15e-ea8c-4131-af58-41250c0ce40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84263576aaec455a91b6035cc5dca4ff'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.875285 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-49d6e15e-ea8c-4131-af58-41250c0ce40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84263576aaec455a91b6035cc5dca4ff'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.875989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-49d6e15e-ea8c-4131-af58-41250c0ce40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84263576aaec455a91b6035cc5dca4ff'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.883254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-49d6e15e-ea8c-4131-af58-41250c0ce40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84263576aaec455a91b6035cc5dca4ff'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.890555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1015/2040] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:14 2022] DELETE /identity/v3/users/84263576aaec455a91b6035cc5dca4ff => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:15.139713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.142066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:15.213431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c82ebc-cf38-4df3-8fac-41bec28c4491 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.275836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.276790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.277242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.277577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] PATH_INFO: `/v3/projects/e02037a2b8e6466b9c864110fb43910a` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.279559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02037a2b8e6466b9c864110fb43910a)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.281404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.334715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02037a2b8e6466b9c864110fb43910a', 'request_id': 'req-eb44bec6-94c1-4855-9999-15870f11923b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:15.342601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02037a2b8e6466b9c864110fb43910a', 'request_id': 'req-eb44bec6-94c1-4855-9999-15870f11923b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:15.350134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02037a2b8e6466b9c864110fb43910a', 'request_id': 'req-eb44bec6-94c1-4855-9999-15870f11923b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:15.362134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] The token cache is being invalidate because project e02037a2b8e6466b9c864110fb43910a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:15.362430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:15.363114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-eb44bec6-94c1-4855-9999-15870f11923b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:15.364709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1026/2041] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:15 2022] DELETE /identity/v3/projects/e02037a2b8e6466b9c864110fb43910a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:15.371027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e46cba-cfc2-42c1-b750-ffc86736c734 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.371338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e46cba-cfc2-42c1-b750-ffc86736c734 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.371820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e46cba-cfc2-42c1-b750-ffc86736c734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.404872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:15.425758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-84e46cba-cfc2-42c1-b750-ffc86736c734 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:15.426987 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-84e46cba-cfc2-42c1-b750-ffc86736c734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:15.487291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1016/2042] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:15.494975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c624e03-a86d-4bed-a278-00d245259727 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.495263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c624e03-a86d-4bed-a278-00d245259727 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.495540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c624e03-a86d-4bed-a278-00d245259727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.526160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9c624e03-a86d-4bed-a278-00d245259727 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:15.527367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9c624e03-a86d-4bed-a278-00d245259727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:15.535350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1027/2043] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:15.539827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e46cba-cfc2-42c1-b750-ffc86736c734 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.549546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e46cba-cfc2-42c1-b750-ffc86736c734 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.554441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695ce4d-a720-4f20-b2e3-00136086f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.555143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695ce4d-a720-4f20-b2e3-00136086f716 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.555427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695ce4d-a720-4f20-b2e3-00136086f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.555703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695ce4d-a720-4f20-b2e3-00136086f716 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.556429 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695ce4d-a720-4f20-b2e3-00136086f716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:15.556740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695ce4d-a720-4f20-b2e3-00136086f716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.558425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695ce4d-a720-4f20-b2e3-00136086f716 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.571420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1017/2044] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:15.575669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c624e03-a86d-4bed-a278-00d245259727 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.585450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c624e03-a86d-4bed-a278-00d245259727 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.590412 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdb27-d320-4044-bbff-326bdff7692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.591074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdb27-d320-4044-bbff-326bdff7692e admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.591356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdb27-d320-4044-bbff-326bdff7692e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.591630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdb27-d320-4044-bbff-326bdff7692e admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.592328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fdb27-d320-4044-bbff-326bdff7692e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.594385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fdb27-d320-4044-bbff-326bdff7692e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.619779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1028/2045] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:15.624505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695ce4d-a720-4f20-b2e3-00136086f716 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.634946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695ce4d-a720-4f20-b2e3-00136086f716 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.696151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527bdad-bae1-48d4-9a60-6e2a66404fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.696841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527bdad-bae1-48d4-9a60-6e2a66404fae admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.697104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527bdad-bae1-48d4-9a60-6e2a66404fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.697381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527bdad-bae1-48d4-9a60-6e2a66404fae admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.698153 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527bdad-bae1-48d4-9a60-6e2a66404fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.700080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527bdad-bae1-48d4-9a60-6e2a66404fae admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.720434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1018/2046] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:15.724663 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdb27-d320-4044-bbff-326bdff7692e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.736350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdb27-d320-4044-bbff-326bdff7692e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.742147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71445b-00f9-413e-b240-1f69fa916551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.742741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71445b-00f9-413e-b240-1f69fa916551 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.743022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71445b-00f9-413e-b240-1f69fa916551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.743301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71445b-00f9-413e-b240-1f69fa916551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.744301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71445b-00f9-413e-b240-1f69fa916551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.745920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71445b-00f9-413e-b240-1f69fa916551 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.748102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:15.758765 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1029/2047] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:15.762648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527bdad-bae1-48d4-9a60-6e2a66404fae admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.773316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527bdad-bae1-48d4-9a60-6e2a66404fae admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.777940 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cabfd-e25e-460e-83a8-b9b9982a2e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.778603 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cabfd-e25e-460e-83a8-b9b9982a2e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.778886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cabfd-e25e-460e-83a8-b9b9982a2e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.779164 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cabfd-e25e-460e-83a8-b9b9982a2e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.779911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cabfd-e25e-460e-83a8-b9b9982a2e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.781750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cabfd-e25e-460e-83a8-b9b9982a2e98 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.791949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1019/2048] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:15.796700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71445b-00f9-413e-b240-1f69fa916551 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.807096 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71445b-00f9-413e-b240-1f69fa916551 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.811893 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651427e6-7875-4cf0-aed4-cfa6a0836d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.812876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651427e6-7875-4cf0-aed4-cfa6a0836d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.813158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651427e6-7875-4cf0-aed4-cfa6a0836d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.813433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651427e6-7875-4cf0-aed4-cfa6a0836d68 admin admin] PATH_INFO: `/v3/projects/f0675e31a0d046eab5d7a69ee393c562/users/15bc438b228d40249a2ba6c2379042ef/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.828271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651427e6-7875-4cf0-aed4-cfa6a0836d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0675e31a0d046eab5d7a69ee393c562, user_id=15bc438b228d40249a2ba6c2379042ef, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.830944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651427e6-7875-4cf0-aed4-cfa6a0836d68 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.845479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1030/2049] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:15 2022] PUT /identity/v3/projects/f0675e31a0d046eab5d7a69ee393c562/users/15bc438b228d40249a2ba6c2379042ef/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:15.856529 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5412-b4b5-4b90-b90e-25935f498149 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.856822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5412-b4b5-4b90-b90e-25935f498149 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.857097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5412-b4b5-4b90-b90e-25935f498149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.885496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-68ab5412-b4b5-4b90-b90e-25935f498149 None None] MFA Rules not processed for user `15bc438b228d40249a2ba6c2379042ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:15.886904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-68ab5412-b4b5-4b90-b90e-25935f498149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:15.935870 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:15.955427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1020/2050] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:15.966434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651427e6-7875-4cf0-aed4-cfa6a0836d68 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.968164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-651427e6-7875-4cf0-aed4-cfa6a0836d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:16.058923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651427e6-7875-4cf0-aed4-cfa6a0836d68 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:16.065318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa62a16-103f-4f9b-bcc0-cb1bcd1fc3ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:16.066002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa62a16-103f-4f9b-bcc0-cb1bcd1fc3ae service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.066286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa62a16-103f-4f9b-bcc0-cb1bcd1fc3ae service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.066558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa62a16-103f-4f9b-bcc0-cb1bcd1fc3ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.074723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa62a16-103f-4f9b-bcc0-cb1bcd1fc3ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:16.076327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa62a16-103f-4f9b-bcc0-cb1bcd1fc3ae service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:16.086055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1031/2051] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:16.293589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab5412-b4b5-4b90-b90e-25935f498149 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:16.357352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab5412-b4b5-4b90-b90e-25935f498149 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:16.364701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:16.365759 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.366195 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.366506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] PATH_INFO: `/v3/users/15bc438b228d40249a2ba6c2379042ef` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.368575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15bc438b228d40249a2ba6c2379042ef)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:16.370843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:16.428830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15bc438b228d40249a2ba6c2379042ef'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:16.435948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15bc438b228d40249a2ba6c2379042ef'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:16.450155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15bc438b228d40249a2ba6c2379042ef'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:16.450936 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15bc438b228d40249a2ba6c2379042ef'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:16.461145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15bc438b228d40249a2ba6c2379042ef'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:16.469547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1021/2052] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:16 2022] DELETE /identity/v3/users/15bc438b228d40249a2ba6c2379042ef => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:16.474399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab15c6-7b1f-4d7b-8429-f36e2b5d1ecd None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.474942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab15c6-7b1f-4d7b-8429-f36e2b5d1ecd None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.475200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab15c6-7b1f-4d7b-8429-f36e2b5d1ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.493671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f7ab15c6-7b1f-4d7b-8429-f36e2b5d1ecd None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:16.494982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f7ab15c6-7b1f-4d7b-8429-f36e2b5d1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:16.566706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1032/2053] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:16.577934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:16.579650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:16.675912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73701703-fa04-4c08-97f9-48769dfd0789 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:16.680144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7716a9-61a3-4cd4-af45-73b47d01fc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:16.680869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7716a9-61a3-4cd4-af45-73b47d01fc43 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.681249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7716a9-61a3-4cd4-af45-73b47d01fc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.681633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7716a9-61a3-4cd4-af45-73b47d01fc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.689113 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:16.695213 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7716a9-61a3-4cd4-af45-73b47d01fc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:16.697121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7716a9-61a3-4cd4-af45-73b47d01fc43 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:16.710739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1022/2054] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:16.995528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab15c6-7b1f-4d7b-8429-f36e2b5d1ecd None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:16.996993 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f7ab15c6-7b1f-4d7b-8429-f36e2b5d1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:17.009991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab15c6-7b1f-4d7b-8429-f36e2b5d1ecd None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.015771 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.016695 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.016950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.017328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] PATH_INFO: `/v3/projects/f0675e31a0d046eab5d7a69ee393c562` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.018560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0675e31a0d046eab5d7a69ee393c562)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.020508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.066293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:17.074965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0675e31a0d046eab5d7a69ee393c562', 'request_id': 'req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.084796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0675e31a0d046eab5d7a69ee393c562', 'request_id': 'req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.091937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0675e31a0d046eab5d7a69ee393c562', 'request_id': 'req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.104588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] The token cache is being invalidate because project f0675e31a0d046eab5d7a69ee393c562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:17.104941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.105615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4fc0db22-bb2e-48b1-aaee-d45dc36bb26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.107265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1033/2055] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:16 2022] DELETE /identity/v3/projects/f0675e31a0d046eab5d7a69ee393c562 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:17.113610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a2e0c-20b8-448e-804e-5cacc4085625 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.114135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a2e0c-20b8-448e-804e-5cacc4085625 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.114498 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a2e0c-20b8-448e-804e-5cacc4085625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.133500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-e89a2e0c-20b8-448e-804e-5cacc4085625 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:17.134753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e89a2e0c-20b8-448e-804e-5cacc4085625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:17.199124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1023/2056] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:17.207592 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da94f25-50b2-4188-90c3-25be5f2512f2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.207880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da94f25-50b2-4188-90c3-25be5f2512f2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.208183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da94f25-50b2-4188-90c3-25be5f2512f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.231590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3da94f25-50b2-4188-90c3-25be5f2512f2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:17.232791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3da94f25-50b2-4188-90c3-25be5f2512f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:17.241101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1034/2057] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:17.245327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a2e0c-20b8-448e-804e-5cacc4085625 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.257572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a2e0c-20b8-448e-804e-5cacc4085625 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.263603 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df415594-accf-4d6a-96ff-551e860d74f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.265098 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415594-accf-4d6a-96ff-551e860d74f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.265649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415594-accf-4d6a-96ff-551e860d74f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.266022 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415594-accf-4d6a-96ff-551e860d74f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.266904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df415594-accf-4d6a-96ff-551e860d74f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:17.267206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df415594-accf-4d6a-96ff-551e860d74f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.269133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df415594-accf-4d6a-96ff-551e860d74f7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.282392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1024/2058] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:57:17.286643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da94f25-50b2-4188-90c3-25be5f2512f2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.296601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da94f25-50b2-4188-90c3-25be5f2512f2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.301284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b11148-4785-4c7e-8449-8feea1e66cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.301979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b11148-4785-4c7e-8449-8feea1e66cdb admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.302258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b11148-4785-4c7e-8449-8feea1e66cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.302703 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b11148-4785-4c7e-8449-8feea1e66cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.303405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b11148-4785-4c7e-8449-8feea1e66cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.305305 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b11148-4785-4c7e-8449-8feea1e66cdb admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.331986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1035/2059] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:17 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:17.336252 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df415594-accf-4d6a-96ff-551e860d74f7 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.347175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df415594-accf-4d6a-96ff-551e860d74f7 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.409231 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e4ef-563a-4744-9f8a-fec89385f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.410060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e4ef-563a-4744-9f8a-fec89385f87c admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.410346 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e4ef-563a-4744-9f8a-fec89385f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.410624 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e4ef-563a-4744-9f8a-fec89385f87c admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.411309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864e4ef-563a-4744-9f8a-fec89385f87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.413223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864e4ef-563a-4744-9f8a-fec89385f87c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.432544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1025/2060] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:17 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:17.436683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b11148-4785-4c7e-8449-8feea1e66cdb admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.447048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b11148-4785-4c7e-8449-8feea1e66cdb admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.451823 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278dec7-72cb-43b2-9ea3-c42b26625de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.453119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278dec7-72cb-43b2-9ea3-c42b26625de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.453306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278dec7-72cb-43b2-9ea3-c42b26625de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.453578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278dec7-72cb-43b2-9ea3-c42b26625de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.454427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278dec7-72cb-43b2-9ea3-c42b26625de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.456001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278dec7-72cb-43b2-9ea3-c42b26625de2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.466372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1036/2061] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:17.470978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e4ef-563a-4744-9f8a-fec89385f87c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.480988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e4ef-563a-4744-9f8a-fec89385f87c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.485876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e1c42-0ad2-46f7-b5d1-f34529c9fa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.486556 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e1c42-0ad2-46f7-b5d1-f34529c9fa1a admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.486838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e1c42-0ad2-46f7-b5d1-f34529c9fa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.487114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e1c42-0ad2-46f7-b5d1-f34529c9fa1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.487834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e1c42-0ad2-46f7-b5d1-f34529c9fa1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.489423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e1c42-0ad2-46f7-b5d1-f34529c9fa1a admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.500072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1026/2062] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:17.504149 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278dec7-72cb-43b2-9ea3-c42b26625de2 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.515790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278dec7-72cb-43b2-9ea3-c42b26625de2 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.520732 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52657dbe-f5a7-42b4-b11a-7a68500df86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.521627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52657dbe-f5a7-42b4-b11a-7a68500df86a admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.521932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52657dbe-f5a7-42b4-b11a-7a68500df86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.522218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52657dbe-f5a7-42b4-b11a-7a68500df86a admin admin] PATH_INFO: `/v3/projects/f81f5e09a6bd44e898c90b5530614214/users/e01aa715163f4b3f80b4088627f72b09/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.537218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52657dbe-f5a7-42b4-b11a-7a68500df86a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81f5e09a6bd44e898c90b5530614214, user_id=e01aa715163f4b3f80b4088627f72b09, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.539820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52657dbe-f5a7-42b4-b11a-7a68500df86a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.553366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1037/2063] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:17 2022] PUT /identity/v3/projects/f81f5e09a6bd44e898c90b5530614214/users/e01aa715163f4b3f80b4088627f72b09/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:17.564709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5dd6-1f76-4eee-9876-6690a50fc8ce None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.565030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5dd6-1f76-4eee-9876-6690a50fc8ce None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.565314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5dd6-1f76-4eee-9876-6690a50fc8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.594169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6a7e5dd6-1f76-4eee-9876-6690a50fc8ce None None] MFA Rules not processed for user `e01aa715163f4b3f80b4088627f72b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:17.595311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6a7e5dd6-1f76-4eee-9876-6690a50fc8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:17.642077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:17.661910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1027/2064] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:17.666431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52657dbe-f5a7-42b4-b11a-7a68500df86a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.731250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52657dbe-f5a7-42b4-b11a-7a68500df86a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.736349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2fb90-aa24-4f74-923c-c41d459d45d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.737005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2fb90-aa24-4f74-923c-c41d459d45d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.737289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2fb90-aa24-4f74-923c-c41d459d45d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.737584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2fb90-aa24-4f74-923c-c41d459d45d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.738288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2fb90-aa24-4f74-923c-c41d459d45d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.740167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2fb90-aa24-4f74-923c-c41d459d45d5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.772876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1038/2065] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:17 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:17.777375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e5dd6-1f76-4eee-9876-6690a50fc8ce None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.788648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e5dd6-1f76-4eee-9876-6690a50fc8ce None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.852630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854eaa3-8815-4d1a-b681-ddcdc8c15f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.853560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854eaa3-8815-4d1a-b681-ddcdc8c15f75 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.853854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854eaa3-8815-4d1a-b681-ddcdc8c15f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.854155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854eaa3-8815-4d1a-b681-ddcdc8c15f75 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.854852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854eaa3-8815-4d1a-b681-ddcdc8c15f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.856914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854eaa3-8815-4d1a-b681-ddcdc8c15f75 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.879043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1028/2066] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:17 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:17.883039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2fb90-aa24-4f74-923c-c41d459d45d5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.894843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2fb90-aa24-4f74-923c-c41d459d45d5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.899532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253863b-873a-4a9d-99d4-32b3c6fc1a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.900191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253863b-873a-4a9d-99d4-32b3c6fc1a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.900474 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253863b-873a-4a9d-99d4-32b3c6fc1a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.900749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253863b-873a-4a9d-99d4-32b3c6fc1a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.901701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253863b-873a-4a9d-99d4-32b3c6fc1a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.903335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253863b-873a-4a9d-99d4-32b3c6fc1a2e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.917914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1039/2067] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:17.919514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854eaa3-8815-4d1a-b681-ddcdc8c15f75 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.933339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854eaa3-8815-4d1a-b681-ddcdc8c15f75 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.941494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1860dc-7a70-4276-b9a0-e4cd91ff3a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.942431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1860dc-7a70-4276-b9a0-e4cd91ff3a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.942717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1860dc-7a70-4276-b9a0-e4cd91ff3a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.942993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1860dc-7a70-4276-b9a0-e4cd91ff3a12 admin admin] PATH_INFO: `/v3/projects/57bfe910940d4c5aa9a0ba12ad5fa3d9/users/ddadda4eb3864e00bd718b845abdffd9/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.961064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1860dc-7a70-4276-b9a0-e4cd91ff3a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bfe910940d4c5aa9a0ba12ad5fa3d9, user_id=ddadda4eb3864e00bd718b845abdffd9, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.963845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1860dc-7a70-4276-b9a0-e4cd91ff3a12 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.977823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1029/2068] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:17 2022] PUT /identity/v3/projects/57bfe910940d4c5aa9a0ba12ad5fa3d9/users/ddadda4eb3864e00bd718b845abdffd9/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:17.982676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253863b-873a-4a9d-99d4-32b3c6fc1a2e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.994426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253863b-873a-4a9d-99d4-32b3c6fc1a2e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:18.029289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:18.055054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008260c-33c3-4598-9053-ab972933ae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:18.055721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008260c-33c3-4598-9053-ab972933ae42 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:18.056000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008260c-33c3-4598-9053-ab972933ae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:18.056271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008260c-33c3-4598-9053-ab972933ae42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:18.056991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008260c-33c3-4598-9053-ab972933ae42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:18.058636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008260c-33c3-4598-9053-ab972933ae42 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:18.072540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1040/2069] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:18.074116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1860dc-7a70-4276-b9a0-e4cd91ff3a12 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:18.084761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1860dc-7a70-4276-b9a0-e4cd91ff3a12 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:18.089704 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f48e0-02b2-4dae-bb51-8a1d0475d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:18.090623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f48e0-02b2-4dae-bb51-8a1d0475d948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:18.090906 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f48e0-02b2-4dae-bb51-8a1d0475d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:18.091180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f48e0-02b2-4dae-bb51-8a1d0475d948 admin admin] PATH_INFO: `/v3/projects/57bfe910940d4c5aa9a0ba12ad5fa3d9/users/ddadda4eb3864e00bd718b845abdffd9/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:18.093381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f48e0-02b2-4dae-bb51-8a1d0475d948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bfe910940d4c5aa9a0ba12ad5fa3d9, user_id=ddadda4eb3864e00bd718b845abdffd9, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:18.096045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f48e0-02b2-4dae-bb51-8a1d0475d948 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:18.106862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1030/2070] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:18 2022] PUT /identity/v3/projects/57bfe910940d4c5aa9a0ba12ad5fa3d9/users/ddadda4eb3864e00bd718b845abdffd9/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:18.118881 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900993ff-eb8b-46f7-b099-5842c462478d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:18.119168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900993ff-eb8b-46f7-b099-5842c462478d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:18.119440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900993ff-eb8b-46f7-b099-5842c462478d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:18.146085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-900993ff-eb8b-46f7-b099-5842c462478d None None] MFA Rules not processed for user `ddadda4eb3864e00bd718b845abdffd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:18.147283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-900993ff-eb8b-46f7-b099-5842c462478d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:18.214931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1041/2071] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:18.226820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f48e0-02b2-4dae-bb51-8a1d0475d948 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:18.228551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d88f48e0-02b2-4dae-bb51-8a1d0475d948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:18.289842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f48e0-02b2-4dae-bb51-8a1d0475d948 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:18.293732 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f885e-f3b7-4477-b2c7-f6041053545e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:18.294548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f885e-f3b7-4477-b2c7-f6041053545e service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:18.294855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f885e-f3b7-4477-b2c7-f6041053545e service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:18.295112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f885e-f3b7-4477-b2c7-f6041053545e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:18.305246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f885e-f3b7-4477-b2c7-f6041053545e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:18.306639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f885e-f3b7-4477-b2c7-f6041053545e service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:18.316673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1031/2072] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:18.742373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900993ff-eb8b-46f7-b099-5842c462478d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:18.805010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900993ff-eb8b-46f7-b099-5842c462478d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:18.809820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:18.810718 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:18.811001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:18.811273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] PATH_INFO: `/v3/users/e01aa715163f4b3f80b4088627f72b09` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:18.813566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01aa715163f4b3f80b4088627f72b09)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:18.815520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:18.861936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01aa715163f4b3f80b4088627f72b09'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:18.862595 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01aa715163f4b3f80b4088627f72b09'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:18.863195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01aa715163f4b3f80b4088627f72b09'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:18.870094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01aa715163f4b3f80b4088627f72b09'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:18.873735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:18.878980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01aa715163f4b3f80b4088627f72b09'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:18.900665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1042/2073] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:18 2022] DELETE /identity/v3/users/e01aa715163f4b3f80b4088627f72b09 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:18.905340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaa15f-c43f-461c-9510-cae531e531ea None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:18.905875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaa15f-c43f-461c-9510-cae531e531ea None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:18.905875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaa15f-c43f-461c-9510-cae531e531ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:18.923549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ffdaa15f-c43f-461c-9510-cae531e531ea None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:18.924764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ffdaa15f-c43f-461c-9510-cae531e531ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:18.965290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:18.987233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1032/2074] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:18.996707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:18.998138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:19.060415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa07b4f-1c26-4236-bf8c-e2e726f3a800 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:19.064282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cd17a-5041-4058-a5d2-69e25f35bcd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:19.064939 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cd17a-5041-4058-a5d2-69e25f35bcd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.065233 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cd17a-5041-4058-a5d2-69e25f35bcd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.065500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cd17a-5041-4058-a5d2-69e25f35bcd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.075366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cd17a-5041-4058-a5d2-69e25f35bcd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:19.076813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cd17a-5041-4058-a5d2-69e25f35bcd2 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:19.087228 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1043/2075] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:19.386385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaa15f-c43f-461c-9510-cae531e531ea None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:19.387815 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ffdaa15f-c43f-461c-9510-cae531e531ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:19.400839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaa15f-c43f-461c-9510-cae531e531ea None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:19.406106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:19.407149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.407428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.407700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] PATH_INFO: `/v3/projects/f81f5e09a6bd44e898c90b5530614214` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.408887 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81f5e09a6bd44e898c90b5530614214)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:19.410834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:19.459132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81f5e09a6bd44e898c90b5530614214', 'request_id': 'req-e7615d50-7737-4500-9436-472178793c20'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.466172 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81f5e09a6bd44e898c90b5530614214', 'request_id': 'req-e7615d50-7737-4500-9436-472178793c20'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.472975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81f5e09a6bd44e898c90b5530614214', 'request_id': 'req-e7615d50-7737-4500-9436-472178793c20'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.483303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] The token cache is being invalidate because project f81f5e09a6bd44e898c90b5530614214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:19.483910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.484338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.486008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1033/2076] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:19 2022] DELETE /identity/v3/projects/f81f5e09a6bd44e898c90b5530614214 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:19.489909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cd17a-5041-4058-a5d2-69e25f35bcd2 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:19.499704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cd17a-5041-4058-a5d2-69e25f35bcd2 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:19.557115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3c88a-7f57-423a-9873-026f84af0711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:19.558070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3c88a-7f57-423a-9873-026f84af0711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.558359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3c88a-7f57-423a-9873-026f84af0711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.558694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3c88a-7f57-423a-9873-026f84af0711 admin admin] PATH_INFO: `/v3/users/ddadda4eb3864e00bd718b845abdffd9` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.559998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3c88a-7f57-423a-9873-026f84af0711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddadda4eb3864e00bd718b845abdffd9)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:19.562134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3c88a-7f57-423a-9873-026f84af0711 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:19.610967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a6b3c88a-7f57-423a-9873-026f84af0711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddadda4eb3864e00bd718b845abdffd9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.611619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a6b3c88a-7f57-423a-9873-026f84af0711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddadda4eb3864e00bd718b845abdffd9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.612460 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a6b3c88a-7f57-423a-9873-026f84af0711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddadda4eb3864e00bd718b845abdffd9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.619618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a6b3c88a-7f57-423a-9873-026f84af0711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddadda4eb3864e00bd718b845abdffd9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.627431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a6b3c88a-7f57-423a-9873-026f84af0711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddadda4eb3864e00bd718b845abdffd9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.642286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:19.648416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1044/2077] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:19 2022] DELETE /identity/v3/users/ddadda4eb3864e00bd718b845abdffd9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:19.932836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:19.934383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:19.948987 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7615d50-7737-4500-9436-472178793c20 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.011021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.011886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.012166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.012441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] PATH_INFO: `/v3/projects/57bfe910940d4c5aa9a0ba12ad5fa3d9` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.013622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57bfe910940d4c5aa9a0ba12ad5fa3d9)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.015935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.062241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57bfe910940d4c5aa9a0ba12ad5fa3d9', 'request_id': 'req-1083e7c2-6a99-48bd-86fe-ff926e330e2c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:20.069248 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57bfe910940d4c5aa9a0ba12ad5fa3d9', 'request_id': 'req-1083e7c2-6a99-48bd-86fe-ff926e330e2c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:20.075424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57bfe910940d4c5aa9a0ba12ad5fa3d9', 'request_id': 'req-1083e7c2-6a99-48bd-86fe-ff926e330e2c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:20.082208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:20.087063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] The token cache is being invalidate because project 57bfe910940d4c5aa9a0ba12ad5fa3d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:20.087572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:20.088641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1083e7c2-6a99-48bd-86fe-ff926e330e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:20.090247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1034/2078] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:19 2022] DELETE /identity/v3/projects/57bfe910940d4c5aa9a0ba12ad5fa3d9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:20.096169 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a409-cc79-4f0c-a886-740d753e7cb2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.096665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a409-cc79-4f0c-a886-740d753e7cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.096765 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a409-cc79-4f0c-a886-740d753e7cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.116045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6ba5a409-cc79-4f0c-a886-740d753e7cb2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:20.117254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6ba5a409-cc79-4f0c-a886-740d753e7cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:20.177253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1045/2079] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:20.184866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf05b6-8526-4e7d-9b7c-80059492b71d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.185149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf05b6-8526-4e7d-9b7c-80059492b71d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.185421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf05b6-8526-4e7d-9b7c-80059492b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.205640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-cfdf05b6-8526-4e7d-9b7c-80059492b71d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:20.206885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-cfdf05b6-8526-4e7d-9b7c-80059492b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:20.214832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1035/2080] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:20.220186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5a409-cc79-4f0c-a886-740d753e7cb2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.230114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5a409-cc79-4f0c-a886-740d753e7cb2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.234926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320ce22-87c0-4b21-ae0c-63c0be6fbec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.235585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ce22-87c0-4b21-ae0c-63c0be6fbec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.235871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ce22-87c0-4b21-ae0c-63c0be6fbec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.236147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ce22-87c0-4b21-ae0c-63c0be6fbec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.236874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320ce22-87c0-4b21-ae0c-63c0be6fbec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:20.237186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320ce22-87c0-4b21-ae0c-63c0be6fbec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.238843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320ce22-87c0-4b21-ae0c-63c0be6fbec7 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.251508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1046/2081] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:20.255822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf05b6-8526-4e7d-9b7c-80059492b71d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.268261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf05b6-8526-4e7d-9b7c-80059492b71d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.272881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434fa00-dc82-4401-a38a-4450f8c4c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.273534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434fa00-dc82-4401-a38a-4450f8c4c572 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.273949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434fa00-dc82-4401-a38a-4450f8c4c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.274217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434fa00-dc82-4401-a38a-4450f8c4c572 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.274792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434fa00-dc82-4401-a38a-4450f8c4c572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.276687 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434fa00-dc82-4401-a38a-4450f8c4c572 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.310970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1036/2082] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:20 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:20.312612 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320ce22-87c0-4b21-ae0c-63c0be6fbec7 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.322820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320ce22-87c0-4b21-ae0c-63c0be6fbec7 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.388983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29876952-104b-4a86-9c21-a8a978e9db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.390427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29876952-104b-4a86-9c21-a8a978e9db1e admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.390785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29876952-104b-4a86-9c21-a8a978e9db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.391182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29876952-104b-4a86-9c21-a8a978e9db1e admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.391881 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29876952-104b-4a86-9c21-a8a978e9db1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.393811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29876952-104b-4a86-9c21-a8a978e9db1e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.416856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1047/2083] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:20 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:20.420712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434fa00-dc82-4401-a38a-4450f8c4c572 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.431691 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434fa00-dc82-4401-a38a-4450f8c4c572 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.436667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fdc73-24d7-4088-8fb6-0f2e07684219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.437348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fdc73-24d7-4088-8fb6-0f2e07684219 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.437631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fdc73-24d7-4088-8fb6-0f2e07684219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.437940 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fdc73-24d7-4088-8fb6-0f2e07684219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.438712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fdc73-24d7-4088-8fb6-0f2e07684219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.440480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fdc73-24d7-4088-8fb6-0f2e07684219 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.456583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1037/2084] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:20.457996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29876952-104b-4a86-9c21-a8a978e9db1e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.469854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29876952-104b-4a86-9c21-a8a978e9db1e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.474544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a933b6-bed3-4446-a2d0-fe1e2311a9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.475232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a933b6-bed3-4446-a2d0-fe1e2311a9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.475510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a933b6-bed3-4446-a2d0-fe1e2311a9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.475779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a933b6-bed3-4446-a2d0-fe1e2311a9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.476490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a933b6-bed3-4446-a2d0-fe1e2311a9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.478103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a933b6-bed3-4446-a2d0-fe1e2311a9ae admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.489924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1048/2085] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:20.492729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fdc73-24d7-4088-8fb6-0f2e07684219 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.504214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fdc73-24d7-4088-8fb6-0f2e07684219 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.509260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ae3db-ea3f-43e4-8f28-bb6a3ff62b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.510315 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ae3db-ea3f-43e4-8f28-bb6a3ff62b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.510602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ae3db-ea3f-43e4-8f28-bb6a3ff62b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.510882 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ae3db-ea3f-43e4-8f28-bb6a3ff62b70 admin admin] PATH_INFO: `/v3/projects/0075875d3bf7462cb7bcebf9740c9919/users/f31f6646adf24a57a8b61cef97ea196f/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.527664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ae3db-ea3f-43e4-8f28-bb6a3ff62b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0075875d3bf7462cb7bcebf9740c9919, user_id=f31f6646adf24a57a8b61cef97ea196f, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.530701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ae3db-ea3f-43e4-8f28-bb6a3ff62b70 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.544581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1038/2086] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:20 2022] PUT /identity/v3/projects/0075875d3bf7462cb7bcebf9740c9919/users/f31f6646adf24a57a8b61cef97ea196f/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:20.555007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d447be0-0af3-4399-8500-955538aadaba None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.555279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d447be0-0af3-4399-8500-955538aadaba None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.555562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d447be0-0af3-4399-8500-955538aadaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.588307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5d447be0-0af3-4399-8500-955538aadaba None None] MFA Rules not processed for user `f31f6646adf24a57a8b61cef97ea196f`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:20.589530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5d447be0-0af3-4399-8500-955538aadaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:20.647418 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:20.658581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1049/2087] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:20.663170 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ae3db-ea3f-43e4-8f28-bb6a3ff62b70 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.724328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ae3db-ea3f-43e4-8f28-bb6a3ff62b70 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.728849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27441ff9-b226-406f-840d-c7a627bc6acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.729504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441ff9-b226-406f-840d-c7a627bc6acc admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.729787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441ff9-b226-406f-840d-c7a627bc6acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.730096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441ff9-b226-406f-840d-c7a627bc6acc admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.730791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27441ff9-b226-406f-840d-c7a627bc6acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.732675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27441ff9-b226-406f-840d-c7a627bc6acc admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.760535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1039/2088] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:20 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:20.765744 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d447be0-0af3-4399-8500-955538aadaba None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.776870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d447be0-0af3-4399-8500-955538aadaba None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.837822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ca8b-bd8a-468b-83cc-ee5c9892f079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.838783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ca8b-bd8a-468b-83cc-ee5c9892f079 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.839033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ca8b-bd8a-468b-83cc-ee5c9892f079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.839306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ca8b-bd8a-468b-83cc-ee5c9892f079 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.840009 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244ca8b-bd8a-468b-83cc-ee5c9892f079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.841996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244ca8b-bd8a-468b-83cc-ee5c9892f079 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.863029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1050/2089] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:20 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:20.867193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27441ff9-b226-406f-840d-c7a627bc6acc admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.879878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27441ff9-b226-406f-840d-c7a627bc6acc admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.885614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460998d-44c5-40af-9a39-a1a65cc9e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.886364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460998d-44c5-40af-9a39-a1a65cc9e8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.886547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460998d-44c5-40af-9a39-a1a65cc9e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.886840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460998d-44c5-40af-9a39-a1a65cc9e8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.887696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460998d-44c5-40af-9a39-a1a65cc9e8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.890580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460998d-44c5-40af-9a39-a1a65cc9e8b9 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.901915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1040/2090] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:20.906300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ca8b-bd8a-468b-83cc-ee5c9892f079 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.916131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ca8b-bd8a-468b-83cc-ee5c9892f079 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.921212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c6db4-6e9a-4a65-b753-fbe92091120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.922441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c6db4-6e9a-4a65-b753-fbe92091120f admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.922722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c6db4-6e9a-4a65-b753-fbe92091120f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.922995 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c6db4-6e9a-4a65-b753-fbe92091120f admin admin] PATH_INFO: `/v3/projects/862af566971d483badcab9f09d301f3e/users/db71dbf2945f4bfe8240413a067d9cbf/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.938198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c6db4-6e9a-4a65-b753-fbe92091120f admin admin] RBAC: Authorizing `identity:create_grant(project_id=862af566971d483badcab9f09d301f3e, user_id=db71dbf2945f4bfe8240413a067d9cbf, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.940830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c6db4-6e9a-4a65-b753-fbe92091120f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.954385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1051/2091] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:20 2022] PUT /identity/v3/projects/862af566971d483badcab9f09d301f3e/users/db71dbf2945f4bfe8240413a067d9cbf/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:20.958357 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460998d-44c5-40af-9a39-a1a65cc9e8b9 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.969348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460998d-44c5-40af-9a39-a1a65cc9e8b9 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.026608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f34cfb-2a18-4417-9157-50b793129cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.027696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f34cfb-2a18-4417-9157-50b793129cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.027696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f34cfb-2a18-4417-9157-50b793129cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.027696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f34cfb-2a18-4417-9157-50b793129cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.028411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f34cfb-2a18-4417-9157-50b793129cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.030086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f34cfb-2a18-4417-9157-50b793129cd0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.041625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1041/2092] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:21.046571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c6db4-6e9a-4a65-b753-fbe92091120f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.056937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c6db4-6e9a-4a65-b753-fbe92091120f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.062135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cb178-7026-41c7-9013-48de1ac5b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.063237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb178-7026-41c7-9013-48de1ac5b97c admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.063513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb178-7026-41c7-9013-48de1ac5b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.063783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb178-7026-41c7-9013-48de1ac5b97c admin admin] PATH_INFO: `/v3/projects/862af566971d483badcab9f09d301f3e/users/db71dbf2945f4bfe8240413a067d9cbf/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.065749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cb178-7026-41c7-9013-48de1ac5b97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=862af566971d483badcab9f09d301f3e, user_id=db71dbf2945f4bfe8240413a067d9cbf, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.068406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cb178-7026-41c7-9013-48de1ac5b97c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.079875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1052/2093] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:21 2022] PUT /identity/v3/projects/862af566971d483badcab9f09d301f3e/users/db71dbf2945f4bfe8240413a067d9cbf/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:21.091541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbb53-03e2-4512-8074-cea6f3dc0547 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.091827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbb53-03e2-4512-8074-cea6f3dc0547 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.092104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbb53-03e2-4512-8074-cea6f3dc0547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.098974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:21.120592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b0fdbb53-03e2-4512-8074-cea6f3dc0547 None None] MFA Rules not processed for user `db71dbf2945f4bfe8240413a067d9cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:21.121814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b0fdbb53-03e2-4512-8074-cea6f3dc0547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:21.190666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1042/2094] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:21.201193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cb178-7026-41c7-9013-48de1ac5b97c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.203312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-719cb178-7026-41c7-9013-48de1ac5b97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:21.260463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cb178-7026-41c7-9013-48de1ac5b97c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.264411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b7404-9fda-4c42-8dd5-38bdbc41858a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.265284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7404-9fda-4c42-8dd5-38bdbc41858a service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.265570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7404-9fda-4c42-8dd5-38bdbc41858a service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.265848 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7404-9fda-4c42-8dd5-38bdbc41858a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.274974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b7404-9fda-4c42-8dd5-38bdbc41858a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.276385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b7404-9fda-4c42-8dd5-38bdbc41858a service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.286935 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1053/2095] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:21.419461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbb53-03e2-4512-8074-cea6f3dc0547 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.481013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbb53-03e2-4512-8074-cea6f3dc0547 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.486345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.487236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.487519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.487795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] PATH_INFO: `/v3/users/f31f6646adf24a57a8b61cef97ea196f` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.488979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31f6646adf24a57a8b61cef97ea196f)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.490929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.537605 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31f6646adf24a57a8b61cef97ea196f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:21.544277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31f6646adf24a57a8b61cef97ea196f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:21.557050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31f6646adf24a57a8b61cef97ea196f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:21.557738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31f6646adf24a57a8b61cef97ea196f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:21.566631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31f6646adf24a57a8b61cef97ea196f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:21.572806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1043/2096] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:21 2022] DELETE /identity/v3/users/f31f6646adf24a57a8b61cef97ea196f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:21.577730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b88bfa-bf56-4511-9774-432e2d7e7580 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.578056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b88bfa-bf56-4511-9774-432e2d7e7580 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.578363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b88bfa-bf56-4511-9774-432e2d7e7580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.598853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-04b88bfa-bf56-4511-9774-432e2d7e7580 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:21.600096 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-04b88bfa-bf56-4511-9774-432e2d7e7580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:21.648250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:21.664064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1054/2097] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:21.674975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.676551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:21.687723 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:21.738576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f10d7-d8d3-49a1-98a8-242d6bbf23d8 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.742535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989340e0-69d0-4e7e-abd0-0ad12ff14caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.743193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989340e0-69d0-4e7e-abd0-0ad12ff14caf service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.743480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989340e0-69d0-4e7e-abd0-0ad12ff14caf service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.743763 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989340e0-69d0-4e7e-abd0-0ad12ff14caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.754279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989340e0-69d0-4e7e-abd0-0ad12ff14caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.755810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989340e0-69d0-4e7e-abd0-0ad12ff14caf service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.767198 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1044/2098] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:22.154587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b88bfa-bf56-4511-9774-432e2d7e7580 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:22.156918 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-04b88bfa-bf56-4511-9774-432e2d7e7580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:22.170040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b88bfa-bf56-4511-9774-432e2d7e7580 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:22.176856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:22.184732 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:22.185020 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:22.185297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] PATH_INFO: `/v3/projects/0075875d3bf7462cb7bcebf9740c9919` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:22.186889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0075875d3bf7462cb7bcebf9740c9919)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:22.189361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:22.237406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0075875d3bf7462cb7bcebf9740c9919', 'request_id': 'req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.244735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0075875d3bf7462cb7bcebf9740c9919', 'request_id': 'req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.251233 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0075875d3bf7462cb7bcebf9740c9919', 'request_id': 'req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.261486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] The token cache is being invalidate because project 0075875d3bf7462cb7bcebf9740c9919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:22.261802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.262467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.264271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1055/2099] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:22 2022] DELETE /identity/v3/projects/0075875d3bf7462cb7bcebf9740c9919 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:22.268436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989340e0-69d0-4e7e-abd0-0ad12ff14caf service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:22.279465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989340e0-69d0-4e7e-abd0-0ad12ff14caf service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:22.338879 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff716cf7-4f97-40b3-94e0-6c6d8345c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:22.339686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff716cf7-4f97-40b3-94e0-6c6d8345c0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:22.339972 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff716cf7-4f97-40b3-94e0-6c6d8345c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:22.340251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff716cf7-4f97-40b3-94e0-6c6d8345c0ae admin admin] PATH_INFO: `/v3/users/db71dbf2945f4bfe8240413a067d9cbf` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:22.341555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff716cf7-4f97-40b3-94e0-6c6d8345c0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=db71dbf2945f4bfe8240413a067d9cbf)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:22.344060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff716cf7-4f97-40b3-94e0-6c6d8345c0ae admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:22.396100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ff716cf7-4f97-40b3-94e0-6c6d8345c0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db71dbf2945f4bfe8240413a067d9cbf'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.404119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ff716cf7-4f97-40b3-94e0-6c6d8345c0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db71dbf2945f4bfe8240413a067d9cbf'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.416598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ff716cf7-4f97-40b3-94e0-6c6d8345c0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db71dbf2945f4bfe8240413a067d9cbf'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.417295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ff716cf7-4f97-40b3-94e0-6c6d8345c0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db71dbf2945f4bfe8240413a067d9cbf'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.427373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ff716cf7-4f97-40b3-94e0-6c6d8345c0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db71dbf2945f4bfe8240413a067d9cbf'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.433458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1045/2100] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:22 2022] DELETE /identity/v3/users/db71dbf2945f4bfe8240413a067d9cbf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:22.919227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:22.921119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:22.935026 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348e3a2-0e73-45c1-a0f6-692ef7d21b65 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.002456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.003324 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.003616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.003892 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] PATH_INFO: `/v3/projects/862af566971d483badcab9f09d301f3e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.005129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=862af566971d483badcab9f09d301f3e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.007076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.059507 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862af566971d483badcab9f09d301f3e', 'request_id': 'req-1059be4a-a28b-4930-a064-e50a07860f6f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.070079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862af566971d483badcab9f09d301f3e', 'request_id': 'req-1059be4a-a28b-4930-a064-e50a07860f6f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.079371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862af566971d483badcab9f09d301f3e', 'request_id': 'req-1059be4a-a28b-4930-a064-e50a07860f6f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.090879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] The token cache is being invalidate because project 862af566971d483badcab9f09d301f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:23.091164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.091844 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1059be4a-a28b-4930-a064-e50a07860f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.093464 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1056/2101] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:22 2022] DELETE /identity/v3/projects/862af566971d483badcab9f09d301f3e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:23.098434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fc4d-3000-4ec8-b4bd-8c137d41586c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.098727 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fc4d-3000-4ec8-b4bd-8c137d41586c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.099004 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fc4d-3000-4ec8-b4bd-8c137d41586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.118640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3063fc4d-3000-4ec8-b4bd-8c137d41586c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:23.119764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3063fc4d-3000-4ec8-b4bd-8c137d41586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:23.148903 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:23.197970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1046/2102] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:23.210452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31c2b-3a4e-4ca5-a071-bc823050fcad None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.210860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31c2b-3a4e-4ca5-a071-bc823050fcad None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.211346 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31c2b-3a4e-4ca5-a071-bc823050fcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.219935 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:23.234766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e4d31c2b-3a4e-4ca5-a071-bc823050fcad None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:23.236089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e4d31c2b-3a4e-4ca5-a071-bc823050fcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:23.245072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1057/2103] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:23.250083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063fc4d-3000-4ec8-b4bd-8c137d41586c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.260223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063fc4d-3000-4ec8-b4bd-8c137d41586c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.269349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58466e2-d45a-47ab-92d6-5a414c14e0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.272290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58466e2-d45a-47ab-92d6-5a414c14e0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.272589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58466e2-d45a-47ab-92d6-5a414c14e0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.272874 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58466e2-d45a-47ab-92d6-5a414c14e0e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.273638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58466e2-d45a-47ab-92d6-5a414c14e0e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:23.273975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58466e2-d45a-47ab-92d6-5a414c14e0e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.275591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58466e2-d45a-47ab-92d6-5a414c14e0e2 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.290201 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1047/2104] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:23.294749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d31c2b-3a4e-4ca5-a071-bc823050fcad None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.306273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d31c2b-3a4e-4ca5-a071-bc823050fcad None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.314231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b2ca-849d-410c-b144-0190798491f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.315153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b2ca-849d-410c-b144-0190798491f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.315153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b2ca-849d-410c-b144-0190798491f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.315550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b2ca-849d-410c-b144-0190798491f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.316444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331b2ca-849d-410c-b144-0190798491f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.318837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331b2ca-849d-410c-b144-0190798491f3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.352837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1058/2105] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:23.357101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58466e2-d45a-47ab-92d6-5a414c14e0e2 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.375468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58466e2-d45a-47ab-92d6-5a414c14e0e2 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.438463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3a2d2-c2c3-4438-8efd-0fce8f2eb443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.439251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3a2d2-c2c3-4438-8efd-0fce8f2eb443 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.439536 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3a2d2-c2c3-4438-8efd-0fce8f2eb443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.439828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3a2d2-c2c3-4438-8efd-0fce8f2eb443 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.440502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3a2d2-c2c3-4438-8efd-0fce8f2eb443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.442480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3a2d2-c2c3-4438-8efd-0fce8f2eb443 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.466260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1048/2106] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:23.470866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b2ca-849d-410c-b144-0190798491f3 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.486545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b2ca-849d-410c-b144-0190798491f3 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.491537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d4d67-0da2-4d6c-b21f-c8ab14d0cbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.492204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4d67-0da2-4d6c-b21f-c8ab14d0cbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.492489 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4d67-0da2-4d6c-b21f-c8ab14d0cbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.492765 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4d67-0da2-4d6c-b21f-c8ab14d0cbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.493491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d4d67-0da2-4d6c-b21f-c8ab14d0cbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.495169 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d4d67-0da2-4d6c-b21f-c8ab14d0cbc0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.507930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1059/2107] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:23.511953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3a2d2-c2c3-4438-8efd-0fce8f2eb443 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.523026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3a2d2-c2c3-4438-8efd-0fce8f2eb443 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.528169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2756b-b060-405b-9319-d0cb3f6e9eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.528840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2756b-b060-405b-9319-d0cb3f6e9eae admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.529128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2756b-b060-405b-9319-d0cb3f6e9eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.529405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2756b-b060-405b-9319-d0cb3f6e9eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.531325 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2756b-b060-405b-9319-d0cb3f6e9eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.532944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2756b-b060-405b-9319-d0cb3f6e9eae admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.543937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1049/2108] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:23.550212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d4d67-0da2-4d6c-b21f-c8ab14d0cbc0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.565410 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d4d67-0da2-4d6c-b21f-c8ab14d0cbc0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.571289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc04fbb-90ca-45f4-9af1-b67181ef0707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.572254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc04fbb-90ca-45f4-9af1-b67181ef0707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.572605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc04fbb-90ca-45f4-9af1-b67181ef0707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.572943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc04fbb-90ca-45f4-9af1-b67181ef0707 admin admin] PATH_INFO: `/v3/projects/4c92d85785014b3fbe389c7142af5fe9/users/85631abbfed948509b7b6f76d43d6383/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.588905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc04fbb-90ca-45f4-9af1-b67181ef0707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c92d85785014b3fbe389c7142af5fe9, user_id=85631abbfed948509b7b6f76d43d6383, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.591750 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc04fbb-90ca-45f4-9af1-b67181ef0707 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.607900 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1060/2109] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:23 2022] PUT /identity/v3/projects/4c92d85785014b3fbe389c7142af5fe9/users/85631abbfed948509b7b6f76d43d6383/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:23.619844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07d2fe-f87b-4edf-bf01-2285db385b3f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.620157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07d2fe-f87b-4edf-bf01-2285db385b3f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.620441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07d2fe-f87b-4edf-bf01-2285db385b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.646694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-8e07d2fe-f87b-4edf-bf01-2285db385b3f None None] MFA Rules not processed for user `85631abbfed948509b7b6f76d43d6383`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:23.647916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8e07d2fe-f87b-4edf-bf01-2285db385b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:23.714126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1050/2110] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:23.719415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc04fbb-90ca-45f4-9af1-b67181ef0707 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.782477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc04fbb-90ca-45f4-9af1-b67181ef0707 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.787267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13061fe0-2631-4628-9f1c-55f8e52eb78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.787931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13061fe0-2631-4628-9f1c-55f8e52eb78b admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.788211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13061fe0-2631-4628-9f1c-55f8e52eb78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.788484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13061fe0-2631-4628-9f1c-55f8e52eb78b admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.789175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13061fe0-2631-4628-9f1c-55f8e52eb78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.791152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13061fe0-2631-4628-9f1c-55f8e52eb78b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.817897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1061/2111] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:23.821945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07d2fe-f87b-4edf-bf01-2285db385b3f None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.832947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07d2fe-f87b-4edf-bf01-2285db385b3f None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.859011 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:23.896451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8508d-7c04-42c9-827e-a94c1efd15b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.897123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8508d-7c04-42c9-827e-a94c1efd15b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.897401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8508d-7c04-42c9-827e-a94c1efd15b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.897672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8508d-7c04-42c9-827e-a94c1efd15b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.898385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8508d-7c04-42c9-827e-a94c1efd15b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.900348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8508d-7c04-42c9-827e-a94c1efd15b1 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.921846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1051/2112] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:23.925906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13061fe0-2631-4628-9f1c-55f8e52eb78b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.936407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13061fe0-2631-4628-9f1c-55f8e52eb78b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.940968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0339d-740a-4b19-9bb6-f79dd4986b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.941646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0339d-740a-4b19-9bb6-f79dd4986b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.941949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0339d-740a-4b19-9bb6-f79dd4986b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.942221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0339d-740a-4b19-9bb6-f79dd4986b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.942986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0339d-740a-4b19-9bb6-f79dd4986b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.944568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0339d-740a-4b19-9bb6-f79dd4986b52 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.955774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1062/2113] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:23.960340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8508d-7c04-42c9-827e-a94c1efd15b1 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.971823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8508d-7c04-42c9-827e-a94c1efd15b1 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.976488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4abf5d-6548-487c-b4ca-bf350c177544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.977376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4abf5d-6548-487c-b4ca-bf350c177544 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.977663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4abf5d-6548-487c-b4ca-bf350c177544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.977971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4abf5d-6548-487c-b4ca-bf350c177544 admin admin] PATH_INFO: `/v3/projects/772a7e80b76049e79a86d87abe9806b8/users/5743cc2a2e20468dbbdaeb79f2e9c668/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.993328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4abf5d-6548-487c-b4ca-bf350c177544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772a7e80b76049e79a86d87abe9806b8, user_id=5743cc2a2e20468dbbdaeb79f2e9c668, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.995995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4abf5d-6548-487c-b4ca-bf350c177544 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.009352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1052/2114] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:23 2022] PUT /identity/v3/projects/772a7e80b76049e79a86d87abe9806b8/users/5743cc2a2e20468dbbdaeb79f2e9c668/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:24.013282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0339d-740a-4b19-9bb6-f79dd4986b52 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.024490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0339d-740a-4b19-9bb6-f79dd4986b52 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.083242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583b58a-facd-4b1e-899c-2ca0c0dd174c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.084052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583b58a-facd-4b1e-899c-2ca0c0dd174c admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.084354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583b58a-facd-4b1e-899c-2ca0c0dd174c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.084634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583b58a-facd-4b1e-899c-2ca0c0dd174c admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.085385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583b58a-facd-4b1e-899c-2ca0c0dd174c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.087286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583b58a-facd-4b1e-899c-2ca0c0dd174c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.097442 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1063/2115] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:24.101523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4abf5d-6548-487c-b4ca-bf350c177544 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.112461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4abf5d-6548-487c-b4ca-bf350c177544 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.118444 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d657744-e10e-47bc-8de7-d7d9d56fb71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.119901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d657744-e10e-47bc-8de7-d7d9d56fb71d admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.120191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d657744-e10e-47bc-8de7-d7d9d56fb71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.120481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d657744-e10e-47bc-8de7-d7d9d56fb71d admin admin] PATH_INFO: `/v3/projects/772a7e80b76049e79a86d87abe9806b8/users/5743cc2a2e20468dbbdaeb79f2e9c668/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.123410 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d657744-e10e-47bc-8de7-d7d9d56fb71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=772a7e80b76049e79a86d87abe9806b8, user_id=5743cc2a2e20468dbbdaeb79f2e9c668, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.127088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d657744-e10e-47bc-8de7-d7d9d56fb71d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.137762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1053/2116] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:24 2022] PUT /identity/v3/projects/772a7e80b76049e79a86d87abe9806b8/users/5743cc2a2e20468dbbdaeb79f2e9c668/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:24.149221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2cb2a-37ca-4387-97dc-1de46ee6855f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.149508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2cb2a-37ca-4387-97dc-1de46ee6855f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.149784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2cb2a-37ca-4387-97dc-1de46ee6855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.168476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:24.178156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3fc2cb2a-37ca-4387-97dc-1de46ee6855f None None] MFA Rules not processed for user `5743cc2a2e20468dbbdaeb79f2e9c668`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:24.179403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3fc2cb2a-37ca-4387-97dc-1de46ee6855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.247725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1064/2117] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:24.259729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d657744-e10e-47bc-8de7-d7d9d56fb71d admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.261446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0d657744-e10e-47bc-8de7-d7d9d56fb71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.320590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d657744-e10e-47bc-8de7-d7d9d56fb71d admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.324300 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199ecff-d42e-4f6d-89a8-358cab7dbfb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.324946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199ecff-d42e-4f6d-89a8-358cab7dbfb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.325229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199ecff-d42e-4f6d-89a8-358cab7dbfb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.325505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199ecff-d42e-4f6d-89a8-358cab7dbfb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.335330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199ecff-d42e-4f6d-89a8-358cab7dbfb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.336763 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199ecff-d42e-4f6d-89a8-358cab7dbfb0 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.347129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1054/2118] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:24.420026 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2cb2a-37ca-4387-97dc-1de46ee6855f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.430398 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2cb2a-37ca-4387-97dc-1de46ee6855f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.433951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e162e2-a262-4e4e-ab7a-be8ff95fd9a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.434589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e162e2-a262-4e4e-ab7a-be8ff95fd9a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.434894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e162e2-a262-4e4e-ab7a-be8ff95fd9a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.435166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e162e2-a262-4e4e-ab7a-be8ff95fd9a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.495162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e162e2-a262-4e4e-ab7a-be8ff95fd9a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.496672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e162e2-a262-4e4e-ab7a-be8ff95fd9a2 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.506452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1065/2119] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:24.796067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199ecff-d42e-4f6d-89a8-358cab7dbfb0 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.883999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199ecff-d42e-4f6d-89a8-358cab7dbfb0 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.889804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.890728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.891006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.891276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] PATH_INFO: `/v3/users/85631abbfed948509b7b6f76d43d6383` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.892490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85631abbfed948509b7b6f76d43d6383)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.894473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.916949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:24.946226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85631abbfed948509b7b6f76d43d6383'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.954119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85631abbfed948509b7b6f76d43d6383'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.968404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85631abbfed948509b7b6f76d43d6383'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.969219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85631abbfed948509b7b6f76d43d6383'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.977276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85631abbfed948509b7b6f76d43d6383'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.985532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1055/2120] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:24 2022] DELETE /identity/v3/users/85631abbfed948509b7b6f76d43d6383 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:24.991408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394533-4ebd-4173-a5c4-60e312848467 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.991811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394533-4ebd-4173-a5c4-60e312848467 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.992175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394533-4ebd-4173-a5c4-60e312848467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:25.016109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-53394533-4ebd-4173-a5c4-60e312848467 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:25.017248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-53394533-4ebd-4173-a5c4-60e312848467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:25.081299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1066/2121] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:25.091308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:25.093407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:25.154001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3769f-867b-4246-ab3f-329029ac10b8 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:25.158724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ef31-40e9-4609-a06a-a562be9f4b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:25.159363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ef31-40e9-4609-a06a-a562be9f4b04 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:25.159742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ef31-40e9-4609-a06a-a562be9f4b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:25.159901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ef31-40e9-4609-a06a-a562be9f4b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:25.169064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ef31-40e9-4609-a06a-a562be9f4b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:25.170601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ef31-40e9-4609-a06a-a562be9f4b04 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:25.180185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1056/2122] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:25.456318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53394533-4ebd-4173-a5c4-60e312848467 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:25.457803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-53394533-4ebd-4173-a5c4-60e312848467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:25.470643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53394533-4ebd-4173-a5c4-60e312848467 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:25.476229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:25.477096 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:25.477372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:25.477641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] PATH_INFO: `/v3/projects/4c92d85785014b3fbe389c7142af5fe9` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:25.478849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c92d85785014b3fbe389c7142af5fe9)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:25.480748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:25.517925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:25.531541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c92d85785014b3fbe389c7142af5fe9', 'request_id': 'req-4be91fbe-1539-482e-8013-f396d85a5fcd'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.540986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c92d85785014b3fbe389c7142af5fe9', 'request_id': 'req-4be91fbe-1539-482e-8013-f396d85a5fcd'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.548415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c92d85785014b3fbe389c7142af5fe9', 'request_id': 'req-4be91fbe-1539-482e-8013-f396d85a5fcd'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.560973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] The token cache is being invalidate because project 4c92d85785014b3fbe389c7142af5fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:25.561951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.562625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.564293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1067/2123] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:25 2022] DELETE /identity/v3/projects/4c92d85785014b3fbe389c7142af5fe9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:25.569457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ef31-40e9-4609-a06a-a562be9f4b04 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:25.579090 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ef31-40e9-4609-a06a-a562be9f4b04 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:25.639515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a4aac-7676-4184-abe9-ec51c2ef3a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:25.640540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4aac-7676-4184-abe9-ec51c2ef3a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:25.640735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4aac-7676-4184-abe9-ec51c2ef3a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:25.640998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4aac-7676-4184-abe9-ec51c2ef3a3f admin admin] PATH_INFO: `/v3/users/5743cc2a2e20468dbbdaeb79f2e9c668` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:25.642253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a4aac-7676-4184-abe9-ec51c2ef3a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5743cc2a2e20468dbbdaeb79f2e9c668)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:25.644297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a4aac-7676-4184-abe9-ec51c2ef3a3f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:25.697910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:25.699620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-064a4aac-7676-4184-abe9-ec51c2ef3a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5743cc2a2e20468dbbdaeb79f2e9c668'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.713236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-064a4aac-7676-4184-abe9-ec51c2ef3a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5743cc2a2e20468dbbdaeb79f2e9c668'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.729352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-064a4aac-7676-4184-abe9-ec51c2ef3a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5743cc2a2e20468dbbdaeb79f2e9c668'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.730109 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-064a4aac-7676-4184-abe9-ec51c2ef3a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5743cc2a2e20468dbbdaeb79f2e9c668'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.738580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-064a4aac-7676-4184-abe9-ec51c2ef3a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5743cc2a2e20468dbbdaeb79f2e9c668'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.744596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1057/2124] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:25 2022] DELETE /identity/v3/users/5743cc2a2e20468dbbdaeb79f2e9c668 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:26.029425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.032008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.048500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be91fbe-1539-482e-8013-f396d85a5fcd admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.112032 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.112904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.113188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.113453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] PATH_INFO: `/v3/projects/772a7e80b76049e79a86d87abe9806b8` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.114663 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772a7e80b76049e79a86d87abe9806b8)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.116554 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.169949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772a7e80b76049e79a86d87abe9806b8', 'request_id': 'req-499b26d1-0164-457a-83a3-91b626f0ae83'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.178481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772a7e80b76049e79a86d87abe9806b8', 'request_id': 'req-499b26d1-0164-457a-83a3-91b626f0ae83'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.184805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772a7e80b76049e79a86d87abe9806b8', 'request_id': 'req-499b26d1-0164-457a-83a3-91b626f0ae83'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.195706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] The token cache is being invalidate because project 772a7e80b76049e79a86d87abe9806b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:26.195992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.196638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-499b26d1-0164-457a-83a3-91b626f0ae83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.198214 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1068/2125] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:26 2022] DELETE /identity/v3/projects/772a7e80b76049e79a86d87abe9806b8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:26.206186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421302b9-f2f0-4148-9975-c8d6100665df None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.207279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421302b9-f2f0-4148-9975-c8d6100665df None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.208265 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421302b9-f2f0-4148-9975-c8d6100665df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.226612 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-421302b9-f2f0-4148-9975-c8d6100665df None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:26.228075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-421302b9-f2f0-4148-9975-c8d6100665df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.291846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1058/2126] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:26.300282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbf1c3-cec0-44ca-a668-60bb366d8459 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.300752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbf1c3-cec0-44ca-a668-60bb366d8459 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.301113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbf1c3-cec0-44ca-a668-60bb366d8459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.323467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3abbf1c3-cec0-44ca-a668-60bb366d8459 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:26.324730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3abbf1c3-cec0-44ca-a668-60bb366d8459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.334752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1069/2127] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:26.338784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421302b9-f2f0-4148-9975-c8d6100665df None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.350781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421302b9-f2f0-4148-9975-c8d6100665df None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.355867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be141bec-5721-41d2-853b-7878b263a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.356598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be141bec-5721-41d2-853b-7878b263a195 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.356840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be141bec-5721-41d2-853b-7878b263a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.357115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be141bec-5721-41d2-853b-7878b263a195 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.357840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be141bec-5721-41d2-853b-7878b263a195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:26.358201 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be141bec-5721-41d2-853b-7878b263a195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.359895 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be141bec-5721-41d2-853b-7878b263a195 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.374841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1059/2128] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:57:26.379313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbf1c3-cec0-44ca-a668-60bb366d8459 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.390231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbf1c3-cec0-44ca-a668-60bb366d8459 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.395550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c30f5-926d-4fe3-9a38-8245bb7ef2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.396423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c30f5-926d-4fe3-9a38-8245bb7ef2fa admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.396781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c30f5-926d-4fe3-9a38-8245bb7ef2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.397270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c30f5-926d-4fe3-9a38-8245bb7ef2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.398227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c30f5-926d-4fe3-9a38-8245bb7ef2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.400336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c30f5-926d-4fe3-9a38-8245bb7ef2fa admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.428164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1070/2129] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:26.432249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be141bec-5721-41d2-853b-7878b263a195 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.444406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be141bec-5721-41d2-853b-7878b263a195 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.509403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebaffe-75c2-4bc8-bdb7-ab288c8b69f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.510129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebaffe-75c2-4bc8-bdb7-ab288c8b69f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.510572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebaffe-75c2-4bc8-bdb7-ab288c8b69f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.511525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebaffe-75c2-4bc8-bdb7-ab288c8b69f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.511725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebaffe-75c2-4bc8-bdb7-ab288c8b69f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.513963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebaffe-75c2-4bc8-bdb7-ab288c8b69f9 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.539943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1060/2130] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:26.541192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c30f5-926d-4fe3-9a38-8245bb7ef2fa admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.552401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c30f5-926d-4fe3-9a38-8245bb7ef2fa admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.557276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea22264-5d5c-4d95-81f0-5204d5069919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.557974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea22264-5d5c-4d95-81f0-5204d5069919 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.558253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea22264-5d5c-4d95-81f0-5204d5069919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.558522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea22264-5d5c-4d95-81f0-5204d5069919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.559271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea22264-5d5c-4d95-81f0-5204d5069919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.560858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea22264-5d5c-4d95-81f0-5204d5069919 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.572235 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1071/2131] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:26.576329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebaffe-75c2-4bc8-bdb7-ab288c8b69f9 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.587168 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebaffe-75c2-4bc8-bdb7-ab288c8b69f9 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.592033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141a4f2-99c4-4aa5-935b-cb866f56f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.592991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141a4f2-99c4-4aa5-935b-cb866f56f76c admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.593191 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141a4f2-99c4-4aa5-935b-cb866f56f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.593584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141a4f2-99c4-4aa5-935b-cb866f56f76c admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.594445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141a4f2-99c4-4aa5-935b-cb866f56f76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.596118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141a4f2-99c4-4aa5-935b-cb866f56f76c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.606515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1061/2132] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:26.611470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea22264-5d5c-4d95-81f0-5204d5069919 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.622167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea22264-5d5c-4d95-81f0-5204d5069919 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.627724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045814d4-2c80-4863-bafc-692b1f5fadce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.628674 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045814d4-2c80-4863-bafc-692b1f5fadce admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.628976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045814d4-2c80-4863-bafc-692b1f5fadce admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.629276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045814d4-2c80-4863-bafc-692b1f5fadce admin admin] PATH_INFO: `/v3/projects/4778da3633f94ea8959a032145843fea/users/886f9e0f949047c5bb189f81265a072a/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.633412 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:26.648617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045814d4-2c80-4863-bafc-692b1f5fadce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4778da3633f94ea8959a032145843fea, user_id=886f9e0f949047c5bb189f81265a072a, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.651368 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045814d4-2c80-4863-bafc-692b1f5fadce admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.674815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1072/2133] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:26 2022] PUT /identity/v3/projects/4778da3633f94ea8959a032145843fea/users/886f9e0f949047c5bb189f81265a072a/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:26.688207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f21fe-7642-4265-8d7f-28facf507230 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.688504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f21fe-7642-4265-8d7f-28facf507230 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.688786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f21fe-7642-4265-8d7f-28facf507230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.722008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-f56f21fe-7642-4265-8d7f-28facf507230 None None] MFA Rules not processed for user `886f9e0f949047c5bb189f81265a072a`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:26.723755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f56f21fe-7642-4265-8d7f-28facf507230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.755505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:26.822466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1062/2134] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:26.828211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045814d4-2c80-4863-bafc-692b1f5fadce admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.904345 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045814d4-2c80-4863-bafc-692b1f5fadce admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.912063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35556eb6-063c-4f64-8643-45c354d0e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.912787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35556eb6-063c-4f64-8643-45c354d0e439 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.913019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35556eb6-063c-4f64-8643-45c354d0e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.913299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35556eb6-063c-4f64-8643-45c354d0e439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.914038 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35556eb6-063c-4f64-8643-45c354d0e439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.915952 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35556eb6-063c-4f64-8643-45c354d0e439 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.948516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1073/2135] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:26.953354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f21fe-7642-4265-8d7f-28facf507230 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.968107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f21fe-7642-4265-8d7f-28facf507230 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.038994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad98b4-ed6c-456b-a8a6-917eecff0815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.039713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad98b4-ed6c-456b-a8a6-917eecff0815 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.039997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad98b4-ed6c-456b-a8a6-917eecff0815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.040277 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad98b4-ed6c-456b-a8a6-917eecff0815 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.040991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad98b4-ed6c-456b-a8a6-917eecff0815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.043264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad98b4-ed6c-456b-a8a6-917eecff0815 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.069663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1063/2136] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:27.075424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35556eb6-063c-4f64-8643-45c354d0e439 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.087621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35556eb6-063c-4f64-8643-45c354d0e439 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.093084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564df33-f459-4c46-be47-9ec55fab1e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.093763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564df33-f459-4c46-be47-9ec55fab1e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.094315 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564df33-f459-4c46-be47-9ec55fab1e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.094604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564df33-f459-4c46-be47-9ec55fab1e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.095342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564df33-f459-4c46-be47-9ec55fab1e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.096949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564df33-f459-4c46-be47-9ec55fab1e40 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.116615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1074/2137] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:27.121724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad98b4-ed6c-456b-a8a6-917eecff0815 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.135430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564df33-f459-4c46-be47-9ec55fab1e40 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.137271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9564df33-f459-4c46-be47-9ec55fab1e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.140683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad98b4-ed6c-456b-a8a6-917eecff0815 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.146092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eef1e-1360-456c-a5fb-ddb1b18b4fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.146897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eef1e-1360-456c-a5fb-ddb1b18b4fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.147187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eef1e-1360-456c-a5fb-ddb1b18b4fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.147460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eef1e-1360-456c-a5fb-ddb1b18b4fc5 admin admin] PATH_INFO: `/v3/projects/960542b8243e41a3b2f522d396219576/users/f3dac426dc5e4e61a1fd2199597caa22/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.151157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564df33-f459-4c46-be47-9ec55fab1e40 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.156202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.157025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.157309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.157589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] PATH_INFO: `/v3/users/6a430a3d09c54151a02dcd98cfb4faae` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.158838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a430a3d09c54151a02dcd98cfb4faae)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.160910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.167407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1eef1e-1360-456c-a5fb-ddb1b18b4fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960542b8243e41a3b2f522d396219576, user_id=f3dac426dc5e4e61a1fd2199597caa22, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.174687 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1eef1e-1360-456c-a5fb-ddb1b18b4fc5 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.196070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1064/2138] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:27 2022] PUT /identity/v3/projects/960542b8243e41a3b2f522d396219576/users/f3dac426dc5e4e61a1fd2199597caa22/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:27.200477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eef1e-1360-456c-a5fb-ddb1b18b4fc5 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.229520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a430a3d09c54151a02dcd98cfb4faae'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.230486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a430a3d09c54151a02dcd98cfb4faae'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.231121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a430a3d09c54151a02dcd98cfb4faae'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.239467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a430a3d09c54151a02dcd98cfb4faae'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.250714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a430a3d09c54151a02dcd98cfb4faae'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.271787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eef1e-1360-456c-a5fb-ddb1b18b4fc5 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.272711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1075/2139] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:27 2022] DELETE /identity/v3/users/6a430a3d09c54151a02dcd98cfb4faae => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:27.305910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:27.336983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747eac7c-ce63-4df6-b700-ece2242c4d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.337652 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eac7c-ce63-4df6-b700-ece2242c4d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.337964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eac7c-ce63-4df6-b700-ece2242c4d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.338246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eac7c-ce63-4df6-b700-ece2242c4d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.338982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747eac7c-ce63-4df6-b700-ece2242c4d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.340593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747eac7c-ce63-4df6-b700-ece2242c4d6c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.351881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1065/2140] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:27.356219 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.357790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.372957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abe116-c951-45ab-acbe-3c14d58794e5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.377805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b071505-ba3c-4725-8ee0-abba9dc3aece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.378735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b071505-ba3c-4725-8ee0-abba9dc3aece admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.379004 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b071505-ba3c-4725-8ee0-abba9dc3aece admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.379274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b071505-ba3c-4725-8ee0-abba9dc3aece admin admin] PATH_INFO: `/v3/projects/960542b8243e41a3b2f522d396219576/users/f3dac426dc5e4e61a1fd2199597caa22/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.381498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b071505-ba3c-4725-8ee0-abba9dc3aece admin admin] RBAC: Authorizing `identity:create_grant(project_id=960542b8243e41a3b2f522d396219576, user_id=f3dac426dc5e4e61a1fd2199597caa22, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.384157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b071505-ba3c-4725-8ee0-abba9dc3aece admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.397783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1076/2141] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:27 2022] PUT /identity/v3/projects/960542b8243e41a3b2f522d396219576/users/f3dac426dc5e4e61a1fd2199597caa22/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:27.409118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692fab-6e01-4eb3-ad65-bcd7802d4558 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.409401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692fab-6e01-4eb3-ad65-bcd7802d4558 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.409749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692fab-6e01-4eb3-ad65-bcd7802d4558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.441034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4c692fab-6e01-4eb3-ad65-bcd7802d4558 None None] MFA Rules not processed for user `f3dac426dc5e4e61a1fd2199597caa22`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:27.442316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4c692fab-6e01-4eb3-ad65-bcd7802d4558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.476433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b071505-ba3c-4725-8ee0-abba9dc3aece admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.478528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0b071505-ba3c-4725-8ee0-abba9dc3aece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.509433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:27.533710 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1066/2142] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:27.544640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692fab-6e01-4eb3-ad65-bcd7802d4558 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.546864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4c692fab-6e01-4eb3-ad65-bcd7802d4558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.564134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b071505-ba3c-4725-8ee0-abba9dc3aece admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.569372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.570297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.570580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.570867 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] PATH_INFO: `/v3/projects/fb7dcf28d78a48379209f0f237bbe069` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.572091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7dcf28d78a48379209f0f237bbe069)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.574078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.612154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692fab-6e01-4eb3-ad65-bcd7802d4558 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.625193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7dcf28d78a48379209f0f237bbe069', 'request_id': 'req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.634185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7dcf28d78a48379209f0f237bbe069', 'request_id': 'req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.643169 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7dcf28d78a48379209f0f237bbe069', 'request_id': 'req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.665541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] The token cache is being invalidate because project fb7dcf28d78a48379209f0f237bbe069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:27.665986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.668017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.669693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1077/2143] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:27 2022] DELETE /identity/v3/projects/fb7dcf28d78a48379209f0f237bbe069 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:27.673615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.674566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c8f74-50ab-486a-aca6-1f307960af27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.674978 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.675266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8f74-50ab-486a-aca6-1f307960af27 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.675549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8f74-50ab-486a-aca6-1f307960af27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.675823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8f74-50ab-486a-aca6-1f307960af27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.677651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7f5c8f74-50ab-486a-aca6-1f307960af27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.700762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:27.747937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b06fbe-1067-484f-b7e4-a3ae7ec8b326 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.748368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c8f74-50ab-486a-aca6-1f307960af27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.750226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c8f74-50ab-486a-aca6-1f307960af27 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.752781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d05f-5a10-42ac-8eff-a6d4da231fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.753662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d05f-5a10-42ac-8eff-a6d4da231fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.753977 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d05f-5a10-42ac-8eff-a6d4da231fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.754259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d05f-5a10-42ac-8eff-a6d4da231fcf admin admin] PATH_INFO: `/v3/users/a35bf91e9b44479f88ed4d4e40fae923` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.755492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d05f-5a10-42ac-8eff-a6d4da231fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35bf91e9b44479f88ed4d4e40fae923)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.757585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d05f-5a10-42ac-8eff-a6d4da231fcf admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.759825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1067/2144] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:27.827409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0135d05f-5a10-42ac-8eff-a6d4da231fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35bf91e9b44479f88ed4d4e40fae923'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.828237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0135d05f-5a10-42ac-8eff-a6d4da231fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35bf91e9b44479f88ed4d4e40fae923'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.828858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0135d05f-5a10-42ac-8eff-a6d4da231fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35bf91e9b44479f88ed4d4e40fae923'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.830904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:27.840051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0135d05f-5a10-42ac-8eff-a6d4da231fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35bf91e9b44479f88ed4d4e40fae923'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.848613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0135d05f-5a10-42ac-8eff-a6d4da231fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35bf91e9b44479f88ed4d4e40fae923'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.867530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1078/2145] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:27 2022] DELETE /identity/v3/users/a35bf91e9b44479f88ed4d4e40fae923 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:28.064635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c8f74-50ab-486a-aca6-1f307960af27 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.079971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c8f74-50ab-486a-aca6-1f307960af27 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.164502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.165270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.165764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.166119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] PATH_INFO: `/v3/projects/eb14ad4b40584d4b82c7a4cd7dfa303b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.168003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb14ad4b40584d4b82c7a4cd7dfa303b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.173161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.241379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb14ad4b40584d4b82c7a4cd7dfa303b', 'request_id': 'req-e5ca30df-02b4-4ec6-9400-33eb10d87294'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:28.249999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb14ad4b40584d4b82c7a4cd7dfa303b', 'request_id': 'req-e5ca30df-02b4-4ec6-9400-33eb10d87294'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:28.256770 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb14ad4b40584d4b82c7a4cd7dfa303b', 'request_id': 'req-e5ca30df-02b4-4ec6-9400-33eb10d87294'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:28.267672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] The token cache is being invalidate because project eb14ad4b40584d4b82c7a4cd7dfa303b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:28.267986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:28.268673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e5ca30df-02b4-4ec6-9400-33eb10d87294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:28.270308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1068/2146] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:28 2022] DELETE /identity/v3/projects/eb14ad4b40584d4b82c7a4cd7dfa303b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:28.275168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a663df-ffda-405b-a6eb-c4ef6823b565 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.275459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a663df-ffda-405b-a6eb-c4ef6823b565 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.275740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a663df-ffda-405b-a6eb-c4ef6823b565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.295184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-50a663df-ffda-405b-a6eb-c4ef6823b565 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:28.296988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-50a663df-ffda-405b-a6eb-c4ef6823b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:28.360141 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1079/2147] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:28.367975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66456159-bc74-4f0b-8385-4d3fab2fb157 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.368286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66456159-bc74-4f0b-8385-4d3fab2fb157 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.368604 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66456159-bc74-4f0b-8385-4d3fab2fb157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.388205 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-66456159-bc74-4f0b-8385-4d3fab2fb157 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:28.390525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-66456159-bc74-4f0b-8385-4d3fab2fb157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:28.398585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1069/2148] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:28.402781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a663df-ffda-405b-a6eb-c4ef6823b565 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.412979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a663df-ffda-405b-a6eb-c4ef6823b565 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.417531 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f552a-86a3-44ef-af79-28cba5a79bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.418213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f552a-86a3-44ef-af79-28cba5a79bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.418546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f552a-86a3-44ef-af79-28cba5a79bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.418766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f552a-86a3-44ef-af79-28cba5a79bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.419482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f552a-86a3-44ef-af79-28cba5a79bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:28.419785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f552a-86a3-44ef-af79-28cba5a79bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.421460 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f552a-86a3-44ef-af79-28cba5a79bbf admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.432845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1080/2149] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:28.437471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66456159-bc74-4f0b-8385-4d3fab2fb157 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.449474 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66456159-bc74-4f0b-8385-4d3fab2fb157 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.455176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0262b-bc44-432a-b6b5-1d8da7793af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.455841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0262b-bc44-432a-b6b5-1d8da7793af6 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.456169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0262b-bc44-432a-b6b5-1d8da7793af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.456398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0262b-bc44-432a-b6b5-1d8da7793af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.457090 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0262b-bc44-432a-b6b5-1d8da7793af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.459204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0262b-bc44-432a-b6b5-1d8da7793af6 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.487593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1070/2150] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:28 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:28.491772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f552a-86a3-44ef-af79-28cba5a79bbf admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.502157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f552a-86a3-44ef-af79-28cba5a79bbf admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.558287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46123b2-94a6-4e5d-b009-04a47b320da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.558955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46123b2-94a6-4e5d-b009-04a47b320da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.559246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46123b2-94a6-4e5d-b009-04a47b320da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.559526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46123b2-94a6-4e5d-b009-04a47b320da9 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.560216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46123b2-94a6-4e5d-b009-04a47b320da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.562216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46123b2-94a6-4e5d-b009-04a47b320da9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.582613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1081/2151] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:28 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:28.587672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0262b-bc44-432a-b6b5-1d8da7793af6 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.599329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0262b-bc44-432a-b6b5-1d8da7793af6 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.604071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11e0a0-2e32-4356-85b7-a530f88c7f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.604728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11e0a0-2e32-4356-85b7-a530f88c7f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.605008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11e0a0-2e32-4356-85b7-a530f88c7f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.605279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11e0a0-2e32-4356-85b7-a530f88c7f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.606060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11e0a0-2e32-4356-85b7-a530f88c7f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.607658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11e0a0-2e32-4356-85b7-a530f88c7f78 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.618943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1071/2152] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:28.622916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46123b2-94a6-4e5d-b009-04a47b320da9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.632973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46123b2-94a6-4e5d-b009-04a47b320da9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.637755 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8609c9e-11fc-4180-8eff-08ab42329be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.638447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8609c9e-11fc-4180-8eff-08ab42329be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.638987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8609c9e-11fc-4180-8eff-08ab42329be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.639850 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8609c9e-11fc-4180-8eff-08ab42329be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.640572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8609c9e-11fc-4180-8eff-08ab42329be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.642184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8609c9e-11fc-4180-8eff-08ab42329be4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.652124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1082/2153] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:28.657550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11e0a0-2e32-4356-85b7-a530f88c7f78 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.668228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11e0a0-2e32-4356-85b7-a530f88c7f78 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.673488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c9c9f-a17f-4dc1-abee-c491e412b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.674460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c9c9f-a17f-4dc1-abee-c491e412b716 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.674749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c9c9f-a17f-4dc1-abee-c491e412b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.675023 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c9c9f-a17f-4dc1-abee-c491e412b716 admin admin] PATH_INFO: `/v3/projects/a81b67b08ad1412da815b1343a059b3a/users/a72ece5c376741bdbd713b32029a7273/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.686134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:28.691931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c9c9f-a17f-4dc1-abee-c491e412b716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81b67b08ad1412da815b1343a059b3a, user_id=a72ece5c376741bdbd713b32029a7273, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.695267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c9c9f-a17f-4dc1-abee-c491e412b716 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.709568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1072/2154] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:28 2022] PUT /identity/v3/projects/a81b67b08ad1412da815b1343a059b3a/users/a72ece5c376741bdbd713b32029a7273/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:28.720255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39567545-33ba-44f3-ae59-a2c03c21dcf9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.720548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39567545-33ba-44f3-ae59-a2c03c21dcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.720830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39567545-33ba-44f3-ae59-a2c03c21dcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.747793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-39567545-33ba-44f3-ae59-a2c03c21dcf9 None None] MFA Rules not processed for user `a72ece5c376741bdbd713b32029a7273`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:28.749780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-39567545-33ba-44f3-ae59-a2c03c21dcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:28.770607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:28.816849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1083/2155] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:28.829178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c9c9f-a17f-4dc1-abee-c491e412b716 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.830944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-608c9c9f-a17f-4dc1-abee-c491e412b716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:28.887215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c9c9f-a17f-4dc1-abee-c491e412b716 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.892096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8bed3-3e64-4013-967e-88768e788fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.892760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8bed3-3e64-4013-967e-88768e788fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.893042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8bed3-3e64-4013-967e-88768e788fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.893314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8bed3-3e64-4013-967e-88768e788fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.903399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8bed3-3e64-4013-967e-88768e788fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.904871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8bed3-3e64-4013-967e-88768e788fe7 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.915791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1073/2156] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:35.288737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39567545-33ba-44f3-ae59-a2c03c21dcf9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:35.307996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39567545-33ba-44f3-ae59-a2c03c21dcf9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:35.312579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4111314-4fe1-48c7-be8e-db185a584de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:35.313126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4111314-4fe1-48c7-be8e-db185a584de2 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:35.313415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4111314-4fe1-48c7-be8e-db185a584de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:35.313804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4111314-4fe1-48c7-be8e-db185a584de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:35.315621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e4111314-4fe1-48c7-be8e-db185a584de2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:35.383217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4111314-4fe1-48c7-be8e-db185a584de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:35.384580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4111314-4fe1-48c7-be8e-db185a584de2 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:35.394847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1084/2157] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:36.387670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8bed3-3e64-4013-967e-88768e788fe7 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:36.458462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8bed3-3e64-4013-967e-88768e788fe7 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:36.463260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:36.464137 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:36.464419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:36.464699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] PATH_INFO: `/v3/users/a72ece5c376741bdbd713b32029a7273` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:36.465928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72ece5c376741bdbd713b32029a7273)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:36.468540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:36.522884 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72ece5c376741bdbd713b32029a7273'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.530306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72ece5c376741bdbd713b32029a7273'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.542360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72ece5c376741bdbd713b32029a7273'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.543099 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72ece5c376741bdbd713b32029a7273'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.551450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72ece5c376741bdbd713b32029a7273'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.559135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1074/2158] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:36 2022] DELETE /identity/v3/users/a72ece5c376741bdbd713b32029a7273 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:36.564043 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c9c83-8c60-4dea-bdcd-77734deac29b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:36.564530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c9c83-8c60-4dea-bdcd-77734deac29b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:36.564682 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c9c83-8c60-4dea-bdcd-77734deac29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:36.582689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8f7c9c83-8c60-4dea-bdcd-77734deac29b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:36.583948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8f7c9c83-8c60-4dea-bdcd-77734deac29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:36.650429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1085/2159] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:36.664998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:36.666141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:36.681381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:36.740134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c4588-396c-442d-ae80-0b5e45ebfb41 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:36.749449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7835685-e940-4235-8668-c3d08dcdf5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:36.749449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835685-e940-4235-8668-c3d08dcdf5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:36.749449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835685-e940-4235-8668-c3d08dcdf5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:36.749449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835685-e940-4235-8668-c3d08dcdf5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:36.755693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7835685-e940-4235-8668-c3d08dcdf5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:36.757185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7835685-e940-4235-8668-c3d08dcdf5f9 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:36.769041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1075/2160] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:37.090577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c9c83-8c60-4dea-bdcd-77734deac29b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.092716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8f7c9c83-8c60-4dea-bdcd-77734deac29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:37.106512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c9c83-8c60-4dea-bdcd-77734deac29b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.113164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.114238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.114642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.115058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] PATH_INFO: `/v3/projects/a81b67b08ad1412da815b1343a059b3a` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.116249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81b67b08ad1412da815b1343a059b3a)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.118284 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.162868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:37.166558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81b67b08ad1412da815b1343a059b3a', 'request_id': 'req-6e9b9d8e-2929-412f-b816-19ec78b761a1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.175243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81b67b08ad1412da815b1343a059b3a', 'request_id': 'req-6e9b9d8e-2929-412f-b816-19ec78b761a1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.181403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81b67b08ad1412da815b1343a059b3a', 'request_id': 'req-6e9b9d8e-2929-412f-b816-19ec78b761a1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.191843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] The token cache is being invalidate because project a81b67b08ad1412da815b1343a059b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:37.192132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.192769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6e9b9d8e-2929-412f-b816-19ec78b761a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.194357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1086/2161] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:37 2022] DELETE /identity/v3/projects/a81b67b08ad1412da815b1343a059b3a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:37.199555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385c80-98a9-4806-b3d7-13bd90052644 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.199846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385c80-98a9-4806-b3d7-13bd90052644 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.200125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385c80-98a9-4806-b3d7-13bd90052644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.220078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-1b385c80-98a9-4806-b3d7-13bd90052644 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:37.221295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1b385c80-98a9-4806-b3d7-13bd90052644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:37.286509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1076/2162] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:37.294536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4d01e-e677-4b47-b10e-2ca5fed1a045 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.294810 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4d01e-e677-4b47-b10e-2ca5fed1a045 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.295181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4d01e-e677-4b47-b10e-2ca5fed1a045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.314176 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c2e4d01e-e677-4b47-b10e-2ca5fed1a045 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:37.315391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c2e4d01e-e677-4b47-b10e-2ca5fed1a045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:37.324031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1087/2163] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:37.328424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b385c80-98a9-4806-b3d7-13bd90052644 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.338305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b385c80-98a9-4806-b3d7-13bd90052644 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.344786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db71841-13f6-4ea3-8c6f-01c90881b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.345448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71841-13f6-4ea3-8c6f-01c90881b3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.345736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71841-13f6-4ea3-8c6f-01c90881b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.346059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71841-13f6-4ea3-8c6f-01c90881b3b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.346780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db71841-13f6-4ea3-8c6f-01c90881b3b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:37.347087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db71841-13f6-4ea3-8c6f-01c90881b3b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.348685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db71841-13f6-4ea3-8c6f-01c90881b3b1 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.361251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1077/2164] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:37.365707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4d01e-e677-4b47-b10e-2ca5fed1a045 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.376082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4d01e-e677-4b47-b10e-2ca5fed1a045 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.380746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f506a8-374d-4c2c-af75-f9ae6b5f1177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.381392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f506a8-374d-4c2c-af75-f9ae6b5f1177 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.381670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f506a8-374d-4c2c-af75-f9ae6b5f1177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.381976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f506a8-374d-4c2c-af75-f9ae6b5f1177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.382669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f506a8-374d-4c2c-af75-f9ae6b5f1177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.384588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f506a8-374d-4c2c-af75-f9ae6b5f1177 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.410665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1088/2165] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:37 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:37.415135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db71841-13f6-4ea3-8c6f-01c90881b3b1 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.426188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db71841-13f6-4ea3-8c6f-01c90881b3b1 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.485795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5d18f-184d-4d90-8eaf-255eca031fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.486498 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5d18f-184d-4d90-8eaf-255eca031fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.486784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5d18f-184d-4d90-8eaf-255eca031fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.487062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5d18f-184d-4d90-8eaf-255eca031fbc admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.487752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5d18f-184d-4d90-8eaf-255eca031fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.489670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5d18f-184d-4d90-8eaf-255eca031fbc admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.509696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1078/2166] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:37 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:37.514706 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f506a8-374d-4c2c-af75-f9ae6b5f1177 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.524892 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f506a8-374d-4c2c-af75-f9ae6b5f1177 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.530494 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fee5b-f18d-4007-a8c7-88643df6b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.531149 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fee5b-f18d-4007-a8c7-88643df6b970 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.531534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fee5b-f18d-4007-a8c7-88643df6b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.531810 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fee5b-f18d-4007-a8c7-88643df6b970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.532526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fee5b-f18d-4007-a8c7-88643df6b970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.534130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fee5b-f18d-4007-a8c7-88643df6b970 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.544437 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1089/2167] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:37.548585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5d18f-184d-4d90-8eaf-255eca031fbc admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.558544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5d18f-184d-4d90-8eaf-255eca031fbc admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.563835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed01c-130e-4391-8483-1e7f7e0cbdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.564501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed01c-130e-4391-8483-1e7f7e0cbdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.564787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed01c-130e-4391-8483-1e7f7e0cbdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.565064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed01c-130e-4391-8483-1e7f7e0cbdc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.565791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed01c-130e-4391-8483-1e7f7e0cbdc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.567415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed01c-130e-4391-8483-1e7f7e0cbdc5 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.578301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1079/2168] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:37.582782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fee5b-f18d-4007-a8c7-88643df6b970 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.593419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fee5b-f18d-4007-a8c7-88643df6b970 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.598278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34b244-d071-4622-b418-31092eba3e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.599354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34b244-d071-4622-b418-31092eba3e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.599637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34b244-d071-4622-b418-31092eba3e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.599912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34b244-d071-4622-b418-31092eba3e76 admin admin] PATH_INFO: `/v3/projects/924cab5f6f3247b890847fac0b386fb2/users/e17d3e324dff4b049dac55d1a1d51d2e/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.614736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34b244-d071-4622-b418-31092eba3e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924cab5f6f3247b890847fac0b386fb2, user_id=e17d3e324dff4b049dac55d1a1d51d2e, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.617365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34b244-d071-4622-b418-31092eba3e76 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.630844 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1090/2169] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:37 2022] PUT /identity/v3/projects/924cab5f6f3247b890847fac0b386fb2/users/e17d3e324dff4b049dac55d1a1d51d2e/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:37.643441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f972d9b-ab9c-4340-9ea7-7e11562731ad None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.643733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f972d9b-ab9c-4340-9ea7-7e11562731ad None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.644011 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f972d9b-ab9c-4340-9ea7-7e11562731ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.672994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6f972d9b-ab9c-4340-9ea7-7e11562731ad None None] MFA Rules not processed for user `e17d3e324dff4b049dac55d1a1d51d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:37.674369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6f972d9b-ab9c-4340-9ea7-7e11562731ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:37.684260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:37.743232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1080/2170] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:37.755451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34b244-d071-4622-b418-31092eba3e76 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.757132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0a34b244-d071-4622-b418-31092eba3e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:37.816072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34b244-d071-4622-b418-31092eba3e76 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.819885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed486050-405c-4d02-ac22-8f41e7d92468 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9c1cc51e544c90a629feb312a80c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.820568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486050-405c-4d02-ac22-8f41e7d92468 service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.820879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486050-405c-4d02-ac22-8f41e7d92468 service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.821178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486050-405c-4d02-ac22-8f41e7d92468 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.830772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed486050-405c-4d02-ac22-8f41e7d92468 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.832540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed486050-405c-4d02-ac22-8f41e7d92468 service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.843501 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1091/2171] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:40.400675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f972d9b-ab9c-4340-9ea7-7e11562731ad None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.402129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6f972d9b-ab9c-4340-9ea7-7e11562731ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:40.470441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f972d9b-ab9c-4340-9ea7-7e11562731ad None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.475068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.475938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.476218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.476488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] PATH_INFO: `/v3/users/886f9e0f949047c5bb189f81265a072a` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.477673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886f9e0f949047c5bb189f81265a072a)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.479609 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.533737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886f9e0f949047c5bb189f81265a072a'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:40.540787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886f9e0f949047c5bb189f81265a072a'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:40.553907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886f9e0f949047c5bb189f81265a072a'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:40.554642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886f9e0f949047c5bb189f81265a072a'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:40.563601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886f9e0f949047c5bb189f81265a072a'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:40.570101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1081/2172] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:40 2022] DELETE /identity/v3/users/886f9e0f949047c5bb189f81265a072a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:40.574546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2f145-87d9-4b64-83b8-c83e553fda92 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.575017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2f145-87d9-4b64-83b8-c83e553fda92 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.575106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2f145-87d9-4b64-83b8-c83e553fda92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.592322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2eb2f145-87d9-4b64-83b8-c83e553fda92 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:40.593542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2eb2f145-87d9-4b64-83b8-c83e553fda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:40.671229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1092/2173] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:40.681141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.682685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:40.717778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:40.749771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8832-2e84-4d56-9500-b574b52d9442 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.753778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145d704-5cbc-4a3f-930a-d81fa8f94ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.754573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145d704-5cbc-4a3f-930a-d81fa8f94ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.754859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145d704-5cbc-4a3f-930a-d81fa8f94ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.755142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145d704-5cbc-4a3f-930a-d81fa8f94ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.765244 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145d704-5cbc-4a3f-930a-d81fa8f94ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.766740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145d704-5cbc-4a3f-930a-d81fa8f94ab0 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.776777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1082/2174] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:41.056114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2f145-87d9-4b64-83b8-c83e553fda92 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:41.057536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2eb2f145-87d9-4b64-83b8-c83e553fda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:41.070344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2f145-87d9-4b64-83b8-c83e553fda92 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:41.075191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:41.076066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:41.080697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:41.081086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] PATH_INFO: `/v3/projects/4778da3633f94ea8959a032145843fea` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:41.083286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4778da3633f94ea8959a032145843fea)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:41.085254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:41.092529 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:41.137351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4778da3633f94ea8959a032145843fea', 'request_id': 'req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.147059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4778da3633f94ea8959a032145843fea', 'request_id': 'req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.154099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4778da3633f94ea8959a032145843fea', 'request_id': 'req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.164540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] The token cache is being invalidate because project 4778da3633f94ea8959a032145843fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:41.164822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.165434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.167226 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1093/2175] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:41 2022] DELETE /identity/v3/projects/4778da3633f94ea8959a032145843fea => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:41.172238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145d704-5cbc-4a3f-930a-d81fa8f94ab0 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:41.182296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145d704-5cbc-4a3f-930a-d81fa8f94ab0 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:41.240881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae73f-b4ce-429b-88a0-857b07b8d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:41.242020 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae73f-b4ce-429b-88a0-857b07b8d599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:41.242305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae73f-b4ce-429b-88a0-857b07b8d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:41.242579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae73f-b4ce-429b-88a0-857b07b8d599 admin admin] PATH_INFO: `/v3/users/f3dac426dc5e4e61a1fd2199597caa22` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:41.243780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccae73f-b4ce-429b-88a0-857b07b8d599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3dac426dc5e4e61a1fd2199597caa22)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:41.245728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccae73f-b4ce-429b-88a0-857b07b8d599 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:41.294082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3ccae73f-b4ce-429b-88a0-857b07b8d599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3dac426dc5e4e61a1fd2199597caa22'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.301843 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3ccae73f-b4ce-429b-88a0-857b07b8d599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3dac426dc5e4e61a1fd2199597caa22'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.314673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3ccae73f-b4ce-429b-88a0-857b07b8d599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3dac426dc5e4e61a1fd2199597caa22'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.315399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3ccae73f-b4ce-429b-88a0-857b07b8d599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3dac426dc5e4e61a1fd2199597caa22'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.323029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3ccae73f-b4ce-429b-88a0-857b07b8d599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3dac426dc5e4e61a1fd2199597caa22'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.329716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1083/2176] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:41 2022] DELETE /identity/v3/users/f3dac426dc5e4e61a1fd2199597caa22 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:41.627234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:41.628686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:41.642940 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f208af-d0f0-4e5a-80f9-a2fd8887494d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:41.712643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:41.713432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:41.713711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:41.714015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] PATH_INFO: `/v3/projects/960542b8243e41a3b2f522d396219576` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:41.715211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960542b8243e41a3b2f522d396219576)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:41.717619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:41.764292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960542b8243e41a3b2f522d396219576', 'request_id': 'req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.772327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960542b8243e41a3b2f522d396219576', 'request_id': 'req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.778726 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960542b8243e41a3b2f522d396219576', 'request_id': 'req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.791184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] The token cache is being invalidate because project 960542b8243e41a3b2f522d396219576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:41.791895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.792759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e77f7416-1a55-4e4c-8aa7-ebf741cb7d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:41.794693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1094/2177] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:41 2022] DELETE /identity/v3/projects/960542b8243e41a3b2f522d396219576 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:41.801907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b046af-4997-4091-bb7a-7f4878627bde None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:41.802369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b046af-4997-4091-bb7a-7f4878627bde None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:41.802459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b046af-4997-4091-bb7a-7f4878627bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:41.820696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-03b046af-4997-4091-bb7a-7f4878627bde None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:41.821937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-03b046af-4997-4091-bb7a-7f4878627bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:41.876393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:41.897364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1084/2178] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:41.906946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce4550-b758-4393-b009-2daee1ab480f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:41.907238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce4550-b758-4393-b009-2daee1ab480f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:41.907519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce4550-b758-4393-b009-2daee1ab480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:41.927337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a8ce4550-b758-4393-b009-2daee1ab480f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:41.928584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a8ce4550-b758-4393-b009-2daee1ab480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:41.937389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1095/2179] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:41.941385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b046af-4997-4091-bb7a-7f4878627bde None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:41.951910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b046af-4997-4091-bb7a-7f4878627bde None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:41.956624 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8e75f-e1d7-4516-b472-001eadd0564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:41.957292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8e75f-e1d7-4516-b472-001eadd0564a admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:41.957559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8e75f-e1d7-4516-b472-001eadd0564a admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:41.957859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8e75f-e1d7-4516-b472-001eadd0564a admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:41.958708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8e75f-e1d7-4516-b472-001eadd0564a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:41.959017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8e75f-e1d7-4516-b472-001eadd0564a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:41.960704 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8e75f-e1d7-4516-b472-001eadd0564a admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:41.974863 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1085/2180] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:41.979395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce4550-b758-4393-b009-2daee1ab480f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:41.988709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce4550-b758-4393-b009-2daee1ab480f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:41.993367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418f81d-de44-4d9d-9f36-ef934fb25524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:41.994072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418f81d-de44-4d9d-9f36-ef934fb25524 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:41.994354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418f81d-de44-4d9d-9f36-ef934fb25524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:41.994626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418f81d-de44-4d9d-9f36-ef934fb25524 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:41.995320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418f81d-de44-4d9d-9f36-ef934fb25524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:41.997220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418f81d-de44-4d9d-9f36-ef934fb25524 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:42.011877 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:42.026907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1096/2181] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:41 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:42.031686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8e75f-e1d7-4516-b472-001eadd0564a admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:42.041852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8e75f-e1d7-4516-b472-001eadd0564a admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:42.101016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe90ae9-aa27-4d43-9004-594410824e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:42.101725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe90ae9-aa27-4d43-9004-594410824e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:42.102038 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe90ae9-aa27-4d43-9004-594410824e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:42.102683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe90ae9-aa27-4d43-9004-594410824e12 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:42.103377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe90ae9-aa27-4d43-9004-594410824e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:42.105299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe90ae9-aa27-4d43-9004-594410824e12 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:42.125981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1086/2182] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:42 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:42.130191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418f81d-de44-4d9d-9f36-ef934fb25524 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:42.141867 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418f81d-de44-4d9d-9f36-ef934fb25524 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:42.146746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3d2e3-1a0f-424e-8c55-f71f49df4010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:42.147412 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3d2e3-1a0f-424e-8c55-f71f49df4010 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:42.147694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3d2e3-1a0f-424e-8c55-f71f49df4010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:42.147965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3d2e3-1a0f-424e-8c55-f71f49df4010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:42.148687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3d2e3-1a0f-424e-8c55-f71f49df4010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:42.150347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3d2e3-1a0f-424e-8c55-f71f49df4010 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:42.162345 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1097/2183] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:42.166341 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe90ae9-aa27-4d43-9004-594410824e12 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:42.176854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe90ae9-aa27-4d43-9004-594410824e12 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:42.181786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e7e73-859a-4f9f-8eb5-32f643ab8007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:42.182481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e7e73-859a-4f9f-8eb5-32f643ab8007 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:42.182772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e7e73-859a-4f9f-8eb5-32f643ab8007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:42.183052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e7e73-859a-4f9f-8eb5-32f643ab8007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:42.183779 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e7e73-859a-4f9f-8eb5-32f643ab8007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:42.185596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e7e73-859a-4f9f-8eb5-32f643ab8007 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:42.196151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1087/2184] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:42.200362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3d2e3-1a0f-424e-8c55-f71f49df4010 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:42.212289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3d2e3-1a0f-424e-8c55-f71f49df4010 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:42.217691 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567672e7-c8fe-438f-87be-68c227843f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:42.218828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567672e7-c8fe-438f-87be-68c227843f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:42.219129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567672e7-c8fe-438f-87be-68c227843f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:42.219402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567672e7-c8fe-438f-87be-68c227843f87 admin admin] PATH_INFO: `/v3/projects/ccc0e08fdbe447b5b2e74b70d358f249/users/d90a7b178d4f44fd84bd51bf5ec2675f/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:42.234522 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567672e7-c8fe-438f-87be-68c227843f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc0e08fdbe447b5b2e74b70d358f249, user_id=d90a7b178d4f44fd84bd51bf5ec2675f, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:42.237097 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567672e7-c8fe-438f-87be-68c227843f87 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:42.250606 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1098/2185] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:42 2022] PUT /identity/v3/projects/ccc0e08fdbe447b5b2e74b70d358f249/users/d90a7b178d4f44fd84bd51bf5ec2675f/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:42.262750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6e8fc-8b7f-4839-9f58-96e9a635873d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:42.263040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6e8fc-8b7f-4839-9f58-96e9a635873d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:42.263324 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6e8fc-8b7f-4839-9f58-96e9a635873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:42.292824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-67a6e8fc-8b7f-4839-9f58-96e9a635873d None None] MFA Rules not processed for user `d90a7b178d4f44fd84bd51bf5ec2675f`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:42.294844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-67a6e8fc-8b7f-4839-9f58-96e9a635873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:42.364008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1088/2186] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:42.376059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567672e7-c8fe-438f-87be-68c227843f87 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:42.377733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-567672e7-c8fe-438f-87be-68c227843f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:42.435950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567672e7-c8fe-438f-87be-68c227843f87 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:42.439741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57092942-34e2-4a95-ba4e-d9250de66809 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9c1cc51e544c90a629feb312a80c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:42.440386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57092942-34e2-4a95-ba4e-d9250de66809 service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:42.440670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57092942-34e2-4a95-ba4e-d9250de66809 service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:42.440973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57092942-34e2-4a95-ba4e-d9250de66809 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:42.449317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57092942-34e2-4a95-ba4e-d9250de66809 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:42.450804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57092942-34e2-4a95-ba4e-d9250de66809 service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:42.460684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1099/2187] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:52.361050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:52.456431 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:17.926937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab3262-a33f-42ad-a499-718b93f9a667 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:17.927477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab3262-a33f-42ad-a499-718b93f9a667 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:17.927477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab3262-a33f-42ad-a499-718b93f9a667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:17.946824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-50ab3262-a33f-42ad-a499-718b93f9a667 None None] MFA Rules not processed for user `555dc188a72647f3af56b774d04ab4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:17.948137 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-50ab3262-a33f-42ad-a499-718b93f9a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:18.004611 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1089/2188] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:19.177415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57092942-34e2-4a95-ba4e-d9250de66809 service glance] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:19.178834 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-57092942-34e2-4a95-ba4e-d9250de66809 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:19.268415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57092942-34e2-4a95-ba4e-d9250de66809 service glance] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:19.275657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34c82e-c2f6-4703-b3d4-7a96adff5685 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:19.276386 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c82e-c2f6-4703-b3d4-7a96adff5685 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:19.276785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c82e-c2f6-4703-b3d4-7a96adff5685 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:19.277109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c82e-c2f6-4703-b3d4-7a96adff5685 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:19.279851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3d34c82e-c2f6-4703-b3d4-7a96adff5685 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:19.292109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34c82e-c2f6-4703-b3d4-7a96adff5685 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:19.293871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34c82e-c2f6-4703-b3d4-7a96adff5685 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:19.303610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1100/2189] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:24.289415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab3262-a33f-42ad-a499-718b93f9a667 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:24.358683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab3262-a33f-42ad-a499-718b93f9a667 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:24.363256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:24.364116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:24.364394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:24.364664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] PATH_INFO: `/v3/users/d90a7b178d4f44fd84bd51bf5ec2675f` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:24.365872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90a7b178d4f44fd84bd51bf5ec2675f)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:24.367817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:24.417379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90a7b178d4f44fd84bd51bf5ec2675f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:24.424669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90a7b178d4f44fd84bd51bf5ec2675f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:24.439070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90a7b178d4f44fd84bd51bf5ec2675f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:24.439883 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90a7b178d4f44fd84bd51bf5ec2675f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:24.449123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90a7b178d4f44fd84bd51bf5ec2675f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:24.456127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1090/2190] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:24 2022] DELETE /identity/v3/users/d90a7b178d4f44fd84bd51bf5ec2675f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:24.460810 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7f168-8b78-4bb1-9638-46cf098c0f70 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:24.461281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7f168-8b78-4bb1-9638-46cf098c0f70 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:24.461375 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7f168-8b78-4bb1-9638-46cf098c0f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:24.479423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8bb7f168-8b78-4bb1-9638-46cf098c0f70 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:24.480646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8bb7f168-8b78-4bb1-9638-46cf098c0f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:24.547625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1101/2191] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:24.557230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:24.558660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:24.587196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:24.622155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92b146-02db-445d-9ffd-bd32a3dbd861 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:24.627260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96abf59-9134-45e8-b00e-633241f76bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:24.628002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96abf59-9134-45e8-b00e-633241f76bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:24.628287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96abf59-9134-45e8-b00e-633241f76bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:24.628561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96abf59-9134-45e8-b00e-633241f76bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:24.638885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96abf59-9134-45e8-b00e-633241f76bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:24.640604 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96abf59-9134-45e8-b00e-633241f76bd2 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:24.650168 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1091/2192] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:24.952212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7f168-8b78-4bb1-9638-46cf098c0f70 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:24.953690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8bb7f168-8b78-4bb1-9638-46cf098c0f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:24.972275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7f168-8b78-4bb1-9638-46cf098c0f70 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:24.977257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:24.978198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:24.978525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:24.978808 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] PATH_INFO: `/v3/projects/ccc0e08fdbe447b5b2e74b70d358f249` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:24.980067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc0e08fdbe447b5b2e74b70d358f249)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:24.982199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:25.033728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc0e08fdbe447b5b2e74b70d358f249', 'request_id': 'req-8b859adc-2194-49b0-9717-06c64e47e2b4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:25.043715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc0e08fdbe447b5b2e74b70d358f249', 'request_id': 'req-8b859adc-2194-49b0-9717-06c64e47e2b4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:25.051176 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc0e08fdbe447b5b2e74b70d358f249', 'request_id': 'req-8b859adc-2194-49b0-9717-06c64e47e2b4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:25.055105 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:25.063747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] The token cache is being invalidate because project ccc0e08fdbe447b5b2e74b70d358f249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:25.064053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:25.064728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8b859adc-2194-49b0-9717-06c64e47e2b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:25.067076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1102/2193] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:24 2022] DELETE /identity/v3/projects/ccc0e08fdbe447b5b2e74b70d358f249 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:25.071670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5fa7-77a8-4c36-b91b-6d1fe9198633 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.072036 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5fa7-77a8-4c36-b91b-6d1fe9198633 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.072413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5fa7-77a8-4c36-b91b-6d1fe9198633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.092253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-999e5fa7-77a8-4c36-b91b-6d1fe9198633 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:25.093556 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-999e5fa7-77a8-4c36-b91b-6d1fe9198633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:25.157120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1092/2194] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:25.165290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59859b-153f-4da0-935e-99adf718e014 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.165588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59859b-153f-4da0-935e-99adf718e014 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.165868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59859b-153f-4da0-935e-99adf718e014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.188754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-be59859b-153f-4da0-935e-99adf718e014 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:25.189994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-be59859b-153f-4da0-935e-99adf718e014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:25.198066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1103/2195] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:25.203431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e5fa7-77a8-4c36-b91b-6d1fe9198633 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:25.214726 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e5fa7-77a8-4c36-b91b-6d1fe9198633 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:25.220496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cbd38-2912-4ce4-a1a1-47295a30cadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:25.221179 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cbd38-2912-4ce4-a1a1-47295a30cadb admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.221466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cbd38-2912-4ce4-a1a1-47295a30cadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.221768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cbd38-2912-4ce4-a1a1-47295a30cadb admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.222601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cbd38-2912-4ce4-a1a1-47295a30cadb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:25.222860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cbd38-2912-4ce4-a1a1-47295a30cadb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:25.224750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cbd38-2912-4ce4-a1a1-47295a30cadb admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:25.237604 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1093/2196] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:58:25.242280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59859b-153f-4da0-935e-99adf718e014 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:25.252319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59859b-153f-4da0-935e-99adf718e014 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:25.257165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ead89e-f923-461b-a94c-69151a58f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:25.257833 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ead89e-f923-461b-a94c-69151a58f784 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.258142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ead89e-f923-461b-a94c-69151a58f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.258422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ead89e-f923-461b-a94c-69151a58f784 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.259162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ead89e-f923-461b-a94c-69151a58f784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:25.261156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ead89e-f923-461b-a94c-69151a58f784 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:25.289059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1104/2197] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:25 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:25.293258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cbd38-2912-4ce4-a1a1-47295a30cadb admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:25.303755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cbd38-2912-4ce4-a1a1-47295a30cadb admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:25.366383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9f42-d90c-47fd-9361-02def8f3b562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:25.367070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9f42-d90c-47fd-9361-02def8f3b562 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.367357 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9f42-d90c-47fd-9361-02def8f3b562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.367635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9f42-d90c-47fd-9361-02def8f3b562 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.368321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9f42-d90c-47fd-9361-02def8f3b562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:25.370318 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9f42-d90c-47fd-9361-02def8f3b562 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:25.391640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1094/2198] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:25 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:25.396144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ead89e-f923-461b-a94c-69151a58f784 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:25.407123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ead89e-f923-461b-a94c-69151a58f784 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:25.411857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4ab3c-8c2d-4950-aff5-0f482cb203a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:25.412518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ab3c-8c2d-4950-aff5-0f482cb203a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.412801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ab3c-8c2d-4950-aff5-0f482cb203a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.413073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ab3c-8c2d-4950-aff5-0f482cb203a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.413796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4ab3c-8c2d-4950-aff5-0f482cb203a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:25.415442 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4ab3c-8c2d-4950-aff5-0f482cb203a0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:25.429285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1105/2199] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:25.430749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9f42-d90c-47fd-9361-02def8f3b562 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:25.442136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9f42-d90c-47fd-9361-02def8f3b562 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:25.446824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f0ea8-13aa-4d93-bebc-22c313a45483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:25.447499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f0ea8-13aa-4d93-bebc-22c313a45483 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.447808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f0ea8-13aa-4d93-bebc-22c313a45483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.448085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f0ea8-13aa-4d93-bebc-22c313a45483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.448810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f0ea8-13aa-4d93-bebc-22c313a45483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:25.451046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f0ea8-13aa-4d93-bebc-22c313a45483 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:25.461217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1095/2200] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:25.465463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4ab3c-8c2d-4950-aff5-0f482cb203a0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:25.475788 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4ab3c-8c2d-4950-aff5-0f482cb203a0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:25.480460 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2efc0c-3bb0-4fd2-b35c-e256c584b61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:25.481504 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efc0c-3bb0-4fd2-b35c-e256c584b61e admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.481785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efc0c-3bb0-4fd2-b35c-e256c584b61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.482088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efc0c-3bb0-4fd2-b35c-e256c584b61e admin admin] PATH_INFO: `/v3/projects/4c3f8f6294bb452480006d99b4d1c988/users/9544b1d37305445cbf45403b921c5a8c/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.500062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2efc0c-3bb0-4fd2-b35c-e256c584b61e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3f8f6294bb452480006d99b4d1c988, user_id=9544b1d37305445cbf45403b921c5a8c, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:25.503567 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2efc0c-3bb0-4fd2-b35c-e256c584b61e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:25.519008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1106/2201] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:25 2022] PUT /identity/v3/projects/4c3f8f6294bb452480006d99b4d1c988/users/9544b1d37305445cbf45403b921c5a8c/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:25.531591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600685b1-e8fd-4457-bea9-f9501d386352 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.531948 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600685b1-e8fd-4457-bea9-f9501d386352 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.532224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600685b1-e8fd-4457-bea9-f9501d386352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.563972 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-600685b1-e8fd-4457-bea9-f9501d386352 None None] MFA Rules not processed for user `9544b1d37305445cbf45403b921c5a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:25.565414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-600685b1-e8fd-4457-bea9-f9501d386352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:25.591200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:25.653051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1096/2202] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:25.657237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2efc0c-3bb0-4fd2-b35c-e256c584b61e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:25.737489 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2efc0c-3bb0-4fd2-b35c-e256c584b61e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:25.742997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa0317-ffca-41f6-9d59-80653ebfc37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:25.743664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa0317-ffca-41f6-9d59-80653ebfc37f admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.743951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa0317-ffca-41f6-9d59-80653ebfc37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.744225 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa0317-ffca-41f6-9d59-80653ebfc37f admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.744916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa0317-ffca-41f6-9d59-80653ebfc37f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:25.748397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa0317-ffca-41f6-9d59-80653ebfc37f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:25.775871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1107/2203] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:25 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:25.779972 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600685b1-e8fd-4457-bea9-f9501d386352 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:25.791116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600685b1-e8fd-4457-bea9-f9501d386352 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:25.849291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998d177-01f2-4276-afd5-69136dc35c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:25.849910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998d177-01f2-4276-afd5-69136dc35c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.850188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998d177-01f2-4276-afd5-69136dc35c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.850471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998d177-01f2-4276-afd5-69136dc35c89 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.851163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998d177-01f2-4276-afd5-69136dc35c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:25.853109 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998d177-01f2-4276-afd5-69136dc35c89 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:25.873255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1097/2204] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:25 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:25.877314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa0317-ffca-41f6-9d59-80653ebfc37f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:25.888419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa0317-ffca-41f6-9d59-80653ebfc37f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:25.893086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd220451-5f49-4e86-bc25-31ce3431b585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:25.893738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd220451-5f49-4e86-bc25-31ce3431b585 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.894061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd220451-5f49-4e86-bc25-31ce3431b585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.894339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd220451-5f49-4e86-bc25-31ce3431b585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.895059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd220451-5f49-4e86-bc25-31ce3431b585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:25.896640 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd220451-5f49-4e86-bc25-31ce3431b585 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:25.907247 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1108/2205] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:58:25.911301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998d177-01f2-4276-afd5-69136dc35c89 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:25.922140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998d177-01f2-4276-afd5-69136dc35c89 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:25.926721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968fcfa-39ea-4c15-9aaf-c3352395fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:25.927625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968fcfa-39ea-4c15-9aaf-c3352395fda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:25.927907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968fcfa-39ea-4c15-9aaf-c3352395fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:25.928181 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968fcfa-39ea-4c15-9aaf-c3352395fda5 admin admin] PATH_INFO: `/v3/projects/ff5cc1f515094f0dbfc93726027f6841/users/0692aedf13db4e698978c33bcd97caf6/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:25.944320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968fcfa-39ea-4c15-9aaf-c3352395fda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5cc1f515094f0dbfc93726027f6841, user_id=0692aedf13db4e698978c33bcd97caf6, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:25.947000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968fcfa-39ea-4c15-9aaf-c3352395fda5 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:25.959969 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1098/2206] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:25 2022] PUT /identity/v3/projects/ff5cc1f515094f0dbfc93726027f6841/users/0692aedf13db4e698978c33bcd97caf6/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:25.963836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd220451-5f49-4e86-bc25-31ce3431b585 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:25.974012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd220451-5f49-4e86-bc25-31ce3431b585 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:26.030551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a426baf-5dde-480a-91da-a6137b4ce1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:26.031225 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a426baf-5dde-480a-91da-a6137b4ce1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:26.031558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a426baf-5dde-480a-91da-a6137b4ce1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:26.031836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a426baf-5dde-480a-91da-a6137b4ce1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:26.032553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a426baf-5dde-480a-91da-a6137b4ce1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:26.034198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a426baf-5dde-480a-91da-a6137b4ce1e1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:26.039414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:26.048851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1109/2207] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:26.050002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968fcfa-39ea-4c15-9aaf-c3352395fda5 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:26.060999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968fcfa-39ea-4c15-9aaf-c3352395fda5 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:26.065636 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b87868-d4ac-469c-80db-3396be6e007c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:26.066554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b87868-d4ac-469c-80db-3396be6e007c admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:26.066832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b87868-d4ac-469c-80db-3396be6e007c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:26.067108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b87868-d4ac-469c-80db-3396be6e007c admin admin] PATH_INFO: `/v3/projects/ff5cc1f515094f0dbfc93726027f6841/users/0692aedf13db4e698978c33bcd97caf6/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:26.069090 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b87868-d4ac-469c-80db-3396be6e007c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5cc1f515094f0dbfc93726027f6841, user_id=0692aedf13db4e698978c33bcd97caf6, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:26.071753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b87868-d4ac-469c-80db-3396be6e007c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:26.081837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1099/2208] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:26 2022] PUT /identity/v3/projects/ff5cc1f515094f0dbfc93726027f6841/users/0692aedf13db4e698978c33bcd97caf6/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:26.092273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60222e6-07cf-4011-bd24-a11ea176c7a0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:26.092587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60222e6-07cf-4011-bd24-a11ea176c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:26.092865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60222e6-07cf-4011-bd24-a11ea176c7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:26.119586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c60222e6-07cf-4011-bd24-a11ea176c7a0 None None] MFA Rules not processed for user `0692aedf13db4e698978c33bcd97caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:26.120797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c60222e6-07cf-4011-bd24-a11ea176c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:26.192598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1110/2209] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:26.204346 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b87868-d4ac-469c-80db-3396be6e007c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:26.206063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d1b87868-d4ac-469c-80db-3396be6e007c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:26.280138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b87868-d4ac-469c-80db-3396be6e007c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:26.283855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d65d5-c9d5-4f56-8d45-1fb01d35e126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:26.284513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d65d5-c9d5-4f56-8d45-1fb01d35e126 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:26.284795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d65d5-c9d5-4f56-8d45-1fb01d35e126 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:26.285072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d65d5-c9d5-4f56-8d45-1fb01d35e126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:26.302088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:26.347279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d65d5-c9d5-4f56-8d45-1fb01d35e126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:26.348724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d65d5-c9d5-4f56-8d45-1fb01d35e126 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:26.358323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1100/2210] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:29.936365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60222e6-07cf-4011-bd24-a11ea176c7a0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:30.002255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60222e6-07cf-4011-bd24-a11ea176c7a0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:30.006981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:30.007852 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:30.008136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:30.008408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] PATH_INFO: `/v3/users/9544b1d37305445cbf45403b921c5a8c` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:30.009598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9544b1d37305445cbf45403b921c5a8c)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:30.011679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:30.067581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9544b1d37305445cbf45403b921c5a8c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.068270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9544b1d37305445cbf45403b921c5a8c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.068881 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9544b1d37305445cbf45403b921c5a8c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.077942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9544b1d37305445cbf45403b921c5a8c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.086637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9544b1d37305445cbf45403b921c5a8c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.104651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1111/2211] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:29 2022] DELETE /identity/v3/users/9544b1d37305445cbf45403b921c5a8c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:30.109698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d96c-ba40-4abf-8909-80e72a9ae680 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:30.110238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d96c-ba40-4abf-8909-80e72a9ae680 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:30.110340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d96c-ba40-4abf-8909-80e72a9ae680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:30.128934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-6731d96c-ba40-4abf-8909-80e72a9ae680 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:30.130263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6731d96c-ba40-4abf-8909-80e72a9ae680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:30.202562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1101/2212] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:30.212685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:30.214175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:30.221475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:30.279748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646181d-7db3-4a54-b3d9-1b71400edab1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:30.283754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e3a90-970d-4856-ac20-2cfc2bb33e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:30.284815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e3a90-970d-4856-ac20-2cfc2bb33e5e service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:30.285145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e3a90-970d-4856-ac20-2cfc2bb33e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:30.285428 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e3a90-970d-4856-ac20-2cfc2bb33e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:30.297077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e3a90-970d-4856-ac20-2cfc2bb33e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:30.298567 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e3a90-970d-4856-ac20-2cfc2bb33e5e service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:30.311147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1112/2213] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:30.689069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731d96c-ba40-4abf-8909-80e72a9ae680 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:30.690611 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6731d96c-ba40-4abf-8909-80e72a9ae680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:30.706323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731d96c-ba40-4abf-8909-80e72a9ae680 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:30.711853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:30.712624 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:30.713470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:30.713470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] PATH_INFO: `/v3/projects/4c3f8f6294bb452480006d99b4d1c988` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:30.714510 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3f8f6294bb452480006d99b4d1c988)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:30.720014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:30.773472 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3f8f6294bb452480006d99b4d1c988', 'request_id': 'req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.781762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3f8f6294bb452480006d99b4d1c988', 'request_id': 'req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.788290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3f8f6294bb452480006d99b4d1c988', 'request_id': 'req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.799856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] The token cache is being invalidate because project 4c3f8f6294bb452480006d99b4d1c988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:30.800176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.800842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.802562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1102/2214] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:30 2022] DELETE /identity/v3/projects/4c3f8f6294bb452480006d99b4d1c988 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:30.806736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e3a90-970d-4856-ac20-2cfc2bb33e5e service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:30.816965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e3a90-970d-4856-ac20-2cfc2bb33e5e service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:30.876312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2091f-e9fd-4129-accd-cc714d509323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:30.877223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2091f-e9fd-4129-accd-cc714d509323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:30.877503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2091f-e9fd-4129-accd-cc714d509323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:30.877781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2091f-e9fd-4129-accd-cc714d509323 admin admin] PATH_INFO: `/v3/users/0692aedf13db4e698978c33bcd97caf6` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:30.879009 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2091f-e9fd-4129-accd-cc714d509323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0692aedf13db4e698978c33bcd97caf6)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:30.880956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2091f-e9fd-4129-accd-cc714d509323 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:30.928451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5dd2091f-e9fd-4129-accd-cc714d509323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0692aedf13db4e698978c33bcd97caf6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.929118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5dd2091f-e9fd-4129-accd-cc714d509323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0692aedf13db4e698978c33bcd97caf6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.929727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5dd2091f-e9fd-4129-accd-cc714d509323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0692aedf13db4e698978c33bcd97caf6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.937506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5dd2091f-e9fd-4129-accd-cc714d509323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0692aedf13db4e698978c33bcd97caf6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.945159 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5dd2091f-e9fd-4129-accd-cc714d509323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0692aedf13db4e698978c33bcd97caf6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:30.962854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1113/2215] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:30 2022] DELETE /identity/v3/users/0692aedf13db4e698978c33bcd97caf6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:31.243595 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:31.245064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:31.261135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee17a9b-94af-42f6-92d4-06d58adf0bbf admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:31.307723 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:31.328066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:31.329227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:31.329638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:31.330047 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] PATH_INFO: `/v3/projects/ff5cc1f515094f0dbfc93726027f6841` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:31.331316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5cc1f515094f0dbfc93726027f6841)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:31.333370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:31.393365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5cc1f515094f0dbfc93726027f6841', 'request_id': 'req-3902abd9-6020-42b5-a1b8-8bd0823b8e42'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:31.405199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5cc1f515094f0dbfc93726027f6841', 'request_id': 'req-3902abd9-6020-42b5-a1b8-8bd0823b8e42'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:31.412320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5cc1f515094f0dbfc93726027f6841', 'request_id': 'req-3902abd9-6020-42b5-a1b8-8bd0823b8e42'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:31.423937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] The token cache is being invalidate because project ff5cc1f515094f0dbfc93726027f6841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:31.424229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:31.424956 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3902abd9-6020-42b5-a1b8-8bd0823b8e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:31.426648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1103/2216] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:31 2022] DELETE /identity/v3/projects/ff5cc1f515094f0dbfc93726027f6841 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:31.431860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc128e50-9574-4be6-9fd7-20a1e0cf6c4a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:31.432144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc128e50-9574-4be6-9fd7-20a1e0cf6c4a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:31.432446 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc128e50-9574-4be6-9fd7-20a1e0cf6c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:31.450886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-dc128e50-9574-4be6-9fd7-20a1e0cf6c4a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:31.452099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dc128e50-9574-4be6-9fd7-20a1e0cf6c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:31.473557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:31.515067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1114/2217] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:31.523074 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aed0c-c4f3-436e-90f4-ac27255e7bdc None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:31.523497 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aed0c-c4f3-436e-90f4-ac27255e7bdc None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:31.523989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aed0c-c4f3-436e-90f4-ac27255e7bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:31.543699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-0b1aed0c-c4f3-436e-90f4-ac27255e7bdc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:31.545190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0b1aed0c-c4f3-436e-90f4-ac27255e7bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:31.553357 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1104/2218] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:31.557746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc128e50-9574-4be6-9fd7-20a1e0cf6c4a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:31.567932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc128e50-9574-4be6-9fd7-20a1e0cf6c4a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:31.572921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398556e1-71c5-4f17-8d4d-8b4ad8ce4613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:31.573582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398556e1-71c5-4f17-8d4d-8b4ad8ce4613 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:31.573865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398556e1-71c5-4f17-8d4d-8b4ad8ce4613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:31.574797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398556e1-71c5-4f17-8d4d-8b4ad8ce4613 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:31.575769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398556e1-71c5-4f17-8d4d-8b4ad8ce4613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:31.576083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398556e1-71c5-4f17-8d4d-8b4ad8ce4613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:31.577686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398556e1-71c5-4f17-8d4d-8b4ad8ce4613 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:31.589861 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1115/2219] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:58:31.594853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aed0c-c4f3-436e-90f4-ac27255e7bdc None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:31.604308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aed0c-c4f3-436e-90f4-ac27255e7bdc None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:31.609872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbecf47-e6e2-4cbc-aafa-6f29b4f7d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:31.610718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecf47-e6e2-4cbc-aafa-6f29b4f7d09c admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:31.611073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecf47-e6e2-4cbc-aafa-6f29b4f7d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:31.611419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecf47-e6e2-4cbc-aafa-6f29b4f7d09c admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:31.612194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbecf47-e6e2-4cbc-aafa-6f29b4f7d09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:31.614278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbecf47-e6e2-4cbc-aafa-6f29b4f7d09c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:31.645919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1105/2220] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:31 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:31.647180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398556e1-71c5-4f17-8d4d-8b4ad8ce4613 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:31.666326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398556e1-71c5-4f17-8d4d-8b4ad8ce4613 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:31.725717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef112df-275a-481f-b468-e717e17736e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:31.726434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef112df-275a-481f-b468-e717e17736e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:31.726720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef112df-275a-481f-b468-e717e17736e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:31.727002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef112df-275a-481f-b468-e717e17736e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:31.727694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef112df-275a-481f-b468-e717e17736e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:31.729621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef112df-275a-481f-b468-e717e17736e7 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:31.750433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1116/2221] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:31 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:31.754491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbecf47-e6e2-4cbc-aafa-6f29b4f7d09c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:31.766666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbecf47-e6e2-4cbc-aafa-6f29b4f7d09c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:31.771718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f3569-3a03-45b5-b863-97cd9fa6b40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:31.772407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f3569-3a03-45b5-b863-97cd9fa6b40f admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:31.772677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f3569-3a03-45b5-b863-97cd9fa6b40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:31.772958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f3569-3a03-45b5-b863-97cd9fa6b40f admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:31.773692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f3569-3a03-45b5-b863-97cd9fa6b40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:31.775329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f3569-3a03-45b5-b863-97cd9fa6b40f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:31.786947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1106/2222] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:58:31.791019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef112df-275a-481f-b468-e717e17736e7 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:31.801728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef112df-275a-481f-b468-e717e17736e7 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:31.806740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae398e-f172-40ff-bd29-2ab566c5f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:31.807451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae398e-f172-40ff-bd29-2ab566c5f125 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:31.807875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae398e-f172-40ff-bd29-2ab566c5f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:31.808165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae398e-f172-40ff-bd29-2ab566c5f125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:31.809090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae398e-f172-40ff-bd29-2ab566c5f125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:31.810803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae398e-f172-40ff-bd29-2ab566c5f125 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:31.821333 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1117/2223] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:58:31.826479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f3569-3a03-45b5-b863-97cd9fa6b40f admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:31.837103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f3569-3a03-45b5-b863-97cd9fa6b40f admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:31.842295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2208db2-3c13-4f47-8111-6182592e58ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:31.843177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2208db2-3c13-4f47-8111-6182592e58ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:31.843464 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2208db2-3c13-4f47-8111-6182592e58ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:31.843740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2208db2-3c13-4f47-8111-6182592e58ea admin admin] PATH_INFO: `/v3/projects/aff79be6c0d441d98eb5b67f2d68137d/users/d215812d468540c199503d16357cf4a0/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:31.859242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2208db2-3c13-4f47-8111-6182592e58ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff79be6c0d441d98eb5b67f2d68137d, user_id=d215812d468540c199503d16357cf4a0, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:31.862014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2208db2-3c13-4f47-8111-6182592e58ea admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:31.875035 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1107/2224] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:31 2022] PUT /identity/v3/projects/aff79be6c0d441d98eb5b67f2d68137d/users/d215812d468540c199503d16357cf4a0/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:31.880293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa51d-258b-42e5-879d-3213d9d5fddc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:31.880588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa51d-258b-42e5-879d-3213d9d5fddc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:31.880895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa51d-258b-42e5-879d-3213d9d5fddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:31.900485 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-508fa51d-258b-42e5-879d-3213d9d5fddc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:31.901795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-508fa51d-258b-42e5-879d-3213d9d5fddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:31.966213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1118/2225] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:31.975900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2208db2-3c13-4f47-8111-6182592e58ea admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:31.977639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a2208db2-3c13-4f47-8111-6182592e58ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:32.038589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2208db2-3c13-4f47-8111-6182592e58ea admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:32.042220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb4d82-7ec1-444e-b7a2-1cb161f442d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:32.042916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4d82-7ec1-444e-b7a2-1cb161f442d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:32.043250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4d82-7ec1-444e-b7a2-1cb161f442d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:32.043527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4d82-7ec1-444e-b7a2-1cb161f442d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:32.053611 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb4d82-7ec1-444e-b7a2-1cb161f442d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:32.055129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb4d82-7ec1-444e-b7a2-1cb161f442d7 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:32.065454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1108/2226] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:32.448103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fa51d-258b-42e5-879d-3213d9d5fddc None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:32.451641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-508fa51d-258b-42e5-879d-3213d9d5fddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:32.470887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fa51d-258b-42e5-879d-3213d9d5fddc None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:32.476928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:32.477269 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:32.477553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:32.477843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] PATH_INFO: `/v3/users/e17d3e324dff4b049dac55d1a1d51d2e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:32.479091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17d3e324dff4b049dac55d1a1d51d2e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:32.481073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:32.515804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:32.542365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17d3e324dff4b049dac55d1a1d51d2e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:32.543166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17d3e324dff4b049dac55d1a1d51d2e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:32.543806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17d3e324dff4b049dac55d1a1d51d2e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:32.559239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17d3e324dff4b049dac55d1a1d51d2e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:32.569290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17d3e324dff4b049dac55d1a1d51d2e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:32.593542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1119/2227] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:32 2022] DELETE /identity/v3/users/e17d3e324dff4b049dac55d1a1d51d2e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:32.597847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69808da5-c242-47ff-bac3-58aad192c37f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:32.598332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69808da5-c242-47ff-bac3-58aad192c37f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:32.598412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69808da5-c242-47ff-bac3-58aad192c37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:32.616818 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-69808da5-c242-47ff-bac3-58aad192c37f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:32.618091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-69808da5-c242-47ff-bac3-58aad192c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:32.626936 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:32.711724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1109/2228] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:32.721418 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:32.723615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:32.819285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d7d33-f839-4a36-a03a-5a4e9ce2e23f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:32.824473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f00df8-bfa3-4882-bb4b-1066f7584e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:32.825262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f00df8-bfa3-4882-bb4b-1066f7584e04 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:32.825648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f00df8-bfa3-4882-bb4b-1066f7584e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:32.826167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f00df8-bfa3-4882-bb4b-1066f7584e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:32.852625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f00df8-bfa3-4882-bb4b-1066f7584e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:32.856794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f00df8-bfa3-4882-bb4b-1066f7584e04 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:32.868641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1120/2229] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:33.445916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69808da5-c242-47ff-bac3-58aad192c37f None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:33.447963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-69808da5-c242-47ff-bac3-58aad192c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:33.476281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69808da5-c242-47ff-bac3-58aad192c37f None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:33.483549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:33.484777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:33.485142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:33.485588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] PATH_INFO: `/v3/projects/924cab5f6f3247b890847fac0b386fb2` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:33.487139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] RBAC: Authorizing `identity:delete_project(project_id=924cab5f6f3247b890847fac0b386fb2)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:33.489824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:33.555542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924cab5f6f3247b890847fac0b386fb2', 'request_id': 'req-a4706c94-666c-4497-9ec3-45827969424c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:33.565447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924cab5f6f3247b890847fac0b386fb2', 'request_id': 'req-a4706c94-666c-4497-9ec3-45827969424c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:33.572721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924cab5f6f3247b890847fac0b386fb2', 'request_id': 'req-a4706c94-666c-4497-9ec3-45827969424c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:33.585152 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] The token cache is being invalidate because project 924cab5f6f3247b890847fac0b386fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:33.585447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:33.586196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a4706c94-666c-4497-9ec3-45827969424c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:33.587772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1110/2230] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:33 2022] DELETE /identity/v3/projects/924cab5f6f3247b890847fac0b386fb2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:33.592923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6749-bea9-44d6-bd5f-ed046117dac6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:33.593510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6749-bea9-44d6-bd5f-ed046117dac6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:33.593830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6749-bea9-44d6-bd5f-ed046117dac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:33.613674 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d94b6749-bea9-44d6-bd5f-ed046117dac6 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:33.615200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d94b6749-bea9-44d6-bd5f-ed046117dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:33.734652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1121/2231] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:33.742797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685f499-f4b0-405a-9653-89f924ff37ae None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:33.743359 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685f499-f4b0-405a-9653-89f924ff37ae None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:33.743576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685f499-f4b0-405a-9653-89f924ff37ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:33.766303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b685f499-f4b0-405a-9653-89f924ff37ae None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:33.767771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b685f499-f4b0-405a-9653-89f924ff37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:33.779716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1111/2232] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:58:33.783919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b6749-bea9-44d6-bd5f-ed046117dac6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:33.797866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b6749-bea9-44d6-bd5f-ed046117dac6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:33.803676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1ded-9688-443a-a9dc-10b393b4d0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:33.804497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1ded-9688-443a-a9dc-10b393b4d0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:33.804847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1ded-9688-443a-a9dc-10b393b4d0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:33.805214 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1ded-9688-443a-a9dc-10b393b4d0ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:33.806071 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1ded-9688-443a-a9dc-10b393b4d0ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:33.806747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1ded-9688-443a-a9dc-10b393b4d0ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:33.808158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1ded-9688-443a-a9dc-10b393b4d0ee admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:33.826701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1122/2233] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:58:33.827828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685f499-f4b0-405a-9653-89f924ff37ae None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:33.838106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685f499-f4b0-405a-9653-89f924ff37ae None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:33.843709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298667f-da29-4c1a-93a9-e4558ee9f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:33.844400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298667f-da29-4c1a-93a9-e4558ee9f25c admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:33.844698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298667f-da29-4c1a-93a9-e4558ee9f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:33.844979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298667f-da29-4c1a-93a9-e4558ee9f25c admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:33.845709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298667f-da29-4c1a-93a9-e4558ee9f25c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:33.848084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298667f-da29-4c1a-93a9-e4558ee9f25c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:33.876335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1112/2234] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:33 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:33.880779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1ded-9688-443a-a9dc-10b393b4d0ee admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:33.893615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1ded-9688-443a-a9dc-10b393b4d0ee admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:33.931007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:33.969859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f052ad-3f58-4798-8d5c-4badc089a78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:33.970700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f052ad-3f58-4798-8d5c-4badc089a78a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:33.971091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f052ad-3f58-4798-8d5c-4badc089a78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:33.971473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f052ad-3f58-4798-8d5c-4badc089a78a admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:33.972287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f052ad-3f58-4798-8d5c-4badc089a78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:33.974363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f052ad-3f58-4798-8d5c-4badc089a78a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:34.000627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1123/2235] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:33 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:34.005518 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298667f-da29-4c1a-93a9-e4558ee9f25c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:34.018803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298667f-da29-4c1a-93a9-e4558ee9f25c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:34.023508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00a4ce-2251-4422-95a6-5850dbcf4421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:34.024180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00a4ce-2251-4422-95a6-5850dbcf4421 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:34.024494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00a4ce-2251-4422-95a6-5850dbcf4421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:34.024773 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00a4ce-2251-4422-95a6-5850dbcf4421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:34.025499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00a4ce-2251-4422-95a6-5850dbcf4421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:34.027146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00a4ce-2251-4422-95a6-5850dbcf4421 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:34.042223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1113/2236] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:34.043720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f052ad-3f58-4798-8d5c-4badc089a78a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:34.054723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f052ad-3f58-4798-8d5c-4badc089a78a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:34.060205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5c989-cd30-41ed-8560-c25c150b06ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:34.060972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c989-cd30-41ed-8560-c25c150b06ea admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:34.061265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c989-cd30-41ed-8560-c25c150b06ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:34.061568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c989-cd30-41ed-8560-c25c150b06ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:34.062332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5c989-cd30-41ed-8560-c25c150b06ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:34.063924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5c989-cd30-41ed-8560-c25c150b06ea admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:34.075505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1124/2237] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:34.079758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00a4ce-2251-4422-95a6-5850dbcf4421 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:34.095239 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00a4ce-2251-4422-95a6-5850dbcf4421 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:34.100361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952c472-0c45-4cb8-806f-019a3ed201a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:34.101466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952c472-0c45-4cb8-806f-019a3ed201a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:34.101753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952c472-0c45-4cb8-806f-019a3ed201a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:34.102060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952c472-0c45-4cb8-806f-019a3ed201a7 admin admin] PATH_INFO: `/v3/projects/29b76dafb1f241ae8adf2cefe1b33ea2/users/abecc765624745d18e1dea20d0c6d3b7/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:34.120346 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952c472-0c45-4cb8-806f-019a3ed201a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b76dafb1f241ae8adf2cefe1b33ea2, user_id=abecc765624745d18e1dea20d0c6d3b7, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:34.123807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952c472-0c45-4cb8-806f-019a3ed201a7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:34.145413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1114/2238] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:34 2022] PUT /identity/v3/projects/29b76dafb1f241ae8adf2cefe1b33ea2/users/abecc765624745d18e1dea20d0c6d3b7/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:34.157218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb56e3-3cd3-438e-b43f-84a6e2e65ab5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:34.157566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb56e3-3cd3-438e-b43f-84a6e2e65ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:34.157786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb56e3-3cd3-438e-b43f-84a6e2e65ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:34.194780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-badb56e3-3cd3-438e-b43f-84a6e2e65ab5 None None] MFA Rules not processed for user `abecc765624745d18e1dea20d0c6d3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:34.196043 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-badb56e3-3cd3-438e-b43f-84a6e2e65ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:34.285424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1125/2239] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:34.298812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952c472-0c45-4cb8-806f-019a3ed201a7 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:34.301324 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2952c472-0c45-4cb8-806f-019a3ed201a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:34.354803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:34.379981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952c472-0c45-4cb8-806f-019a3ed201a7 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:34.387868 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b32fc-3442-4457-844c-3f15115c250f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:34.388899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b32fc-3442-4457-844c-3f15115c250f service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:34.389298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b32fc-3442-4457-844c-3f15115c250f service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:34.389671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b32fc-3442-4457-844c-3f15115c250f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:34.407200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b32fc-3442-4457-844c-3f15115c250f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:34.408844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b32fc-3442-4457-844c-3f15115c250f service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:34.421438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1115/2240] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:36.856276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d899960-98b3-4675-803a-eddfeee0abf4 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:36.857032 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d899960-98b3-4675-803a-eddfeee0abf4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:36.857032 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d899960-98b3-4675-803a-eddfeee0abf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:36.889289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3d899960-98b3-4675-803a-eddfeee0abf4 None None] MFA Rules not processed for user `d215812d468540c199503d16357cf4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:36.894521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3d899960-98b3-4675-803a-eddfeee0abf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:37.021907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1126/2241] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:37.026396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b32fc-3442-4457-844c-3f15115c250f service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:37.031532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9f6b32fc-3442-4457-844c-3f15115c250f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:37.117688 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b32fc-3442-4457-844c-3f15115c250f service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:37.129760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2d3e3-e73f-4985-8fd5-697590122f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:37.130806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2d3e3-e73f-4985-8fd5-697590122f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:37.131163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2d3e3-e73f-4985-8fd5-697590122f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:37.131512 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2d3e3-e73f-4985-8fd5-697590122f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:37.132290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2d3e3-e73f-4985-8fd5-697590122f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:37.134426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2d3e3-e73f-4985-8fd5-697590122f69 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:37.170077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1116/2242] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:37 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:37.172650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d899960-98b3-4675-803a-eddfeee0abf4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:37.191212 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2d3e3-e73f-4985-8fd5-697590122f69 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:37.192726 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d899960-98b3-4675-803a-eddfeee0abf4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:37.234287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:37.294979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc81353-4a9d-427a-8357-f6e015be96f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:37.295671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc81353-4a9d-427a-8357-f6e015be96f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:37.295951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc81353-4a9d-427a-8357-f6e015be96f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:37.296224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc81353-4a9d-427a-8357-f6e015be96f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:37.297113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc81353-4a9d-427a-8357-f6e015be96f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:37.299332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc81353-4a9d-427a-8357-f6e015be96f5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:37.301265 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2d3e3-e73f-4985-8fd5-697590122f69 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:37.306442 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af6c4c-3631-44ff-bde6-92312cceb0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:37.307566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af6c4c-3631-44ff-bde6-92312cceb0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:37.308356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af6c4c-3631-44ff-bde6-92312cceb0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:37.308783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af6c4c-3631-44ff-bde6-92312cceb0bd admin admin] PATH_INFO: `/v3/users/abecc765624745d18e1dea20d0c6d3b7` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:37.311129 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af6c4c-3631-44ff-bde6-92312cceb0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=abecc765624745d18e1dea20d0c6d3b7)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:37.313609 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af6c4c-3631-44ff-bde6-92312cceb0bd admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:37.325741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1127/2243] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:37 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:37.329637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc81353-4a9d-427a-8357-f6e015be96f5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:37.344712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc81353-4a9d-427a-8357-f6e015be96f5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:37.351637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59335193-a7b8-4651-b883-d604280c852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:37.352397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59335193-a7b8-4651-b883-d604280c852c admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:37.352767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59335193-a7b8-4651-b883-d604280c852c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:37.353239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59335193-a7b8-4651-b883-d604280c852c admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:37.365695 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59335193-a7b8-4651-b883-d604280c852c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:37.367616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59335193-a7b8-4651-b883-d604280c852c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:37.392627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-31af6c4c-3631-44ff-bde6-92312cceb0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abecc765624745d18e1dea20d0c6d3b7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:37.399790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1128/2244] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:37.404868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59335193-a7b8-4651-b883-d604280c852c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:37.410112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-31af6c4c-3631-44ff-bde6-92312cceb0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abecc765624745d18e1dea20d0c6d3b7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:37.416260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:37.428206 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59335193-a7b8-4651-b883-d604280c852c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:37.435576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-31af6c4c-3631-44ff-bde6-92312cceb0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abecc765624745d18e1dea20d0c6d3b7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:37.437010 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-31af6c4c-3631-44ff-bde6-92312cceb0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abecc765624745d18e1dea20d0c6d3b7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:37.437660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51e283-f9cb-4e2d-8e0a-7f2a5df5e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:37.438681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51e283-f9cb-4e2d-8e0a-7f2a5df5e28b admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:37.439039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51e283-f9cb-4e2d-8e0a-7f2a5df5e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:37.439391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51e283-f9cb-4e2d-8e0a-7f2a5df5e28b admin admin] PATH_INFO: `/v3/projects/ceee87ee031d4217b819496140c79a11/users/8b5c7c777ed84477b3e3afe408694768/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:37.448597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-31af6c4c-3631-44ff-bde6-92312cceb0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abecc765624745d18e1dea20d0c6d3b7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:37.459200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1117/2245] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:37 2022] DELETE /identity/v3/users/abecc765624745d18e1dea20d0c6d3b7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:37.463610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3c5d-9086-4ad2-87b7-107ae50d1830 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:37.464109 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3c5d-9086-4ad2-87b7-107ae50d1830 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:37.465183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3c5d-9086-4ad2-87b7-107ae50d1830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:37.465593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51e283-f9cb-4e2d-8e0a-7f2a5df5e28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceee87ee031d4217b819496140c79a11, user_id=8b5c7c777ed84477b3e3afe408694768, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:37.469128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51e283-f9cb-4e2d-8e0a-7f2a5df5e28b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:37.488967 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ca9a3c5d-9086-4ad2-87b7-107ae50d1830 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:37.489634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1129/2246] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:37 2022] PUT /identity/v3/projects/ceee87ee031d4217b819496140c79a11/users/8b5c7c777ed84477b3e3afe408694768/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:37.490235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ca9a3c5d-9086-4ad2-87b7-107ae50d1830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:37.491266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51e283-f9cb-4e2d-8e0a-7f2a5df5e28b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:37.494690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8f51e283-f9cb-4e2d-8e0a-7f2a5df5e28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:37.594795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1118/2247] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:37.597273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51e283-f9cb-4e2d-8e0a-7f2a5df5e28b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:37.603799 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee4774-6c08-4b84-8090-141b56979eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:37.604780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4774-6c08-4b84-8090-141b56979eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:37.605796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4774-6c08-4b84-8090-141b56979eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:37.606279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4774-6c08-4b84-8090-141b56979eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:37.607177 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee4774-6c08-4b84-8090-141b56979eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:37.608986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee4774-6c08-4b84-8090-141b56979eb6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:37.610488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a3c5d-9086-4ad2-87b7-107ae50d1830 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:37.612274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ca9a3c5d-9086-4ad2-87b7-107ae50d1830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:37.627081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1130/2248] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:37.628594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee4774-6c08-4b84-8090-141b56979eb6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:37.647664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee4774-6c08-4b84-8090-141b56979eb6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:37.656080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4ca2f-e263-476a-aa90-acac2b5eaa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:37.659922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4ca2f-e263-476a-aa90-acac2b5eaa27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:37.660439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4ca2f-e263-476a-aa90-acac2b5eaa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:37.660884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4ca2f-e263-476a-aa90-acac2b5eaa27 admin admin] PATH_INFO: `/v3/projects/ceee87ee031d4217b819496140c79a11/users/8b5c7c777ed84477b3e3afe408694768/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:37.667266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4ca2f-e263-476a-aa90-acac2b5eaa27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceee87ee031d4217b819496140c79a11, user_id=8b5c7c777ed84477b3e3afe408694768, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:37.672114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4ca2f-e263-476a-aa90-acac2b5eaa27 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:37.688169 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1131/2249] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:37 2022] PUT /identity/v3/projects/ceee87ee031d4217b819496140c79a11/users/8b5c7c777ed84477b3e3afe408694768/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:37.744567 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a3c5d-9086-4ad2-87b7-107ae50d1830 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:37.814389 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c3682-235e-49ae-b74a-7328c677e413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:37.815168 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c3682-235e-49ae-b74a-7328c677e413 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:37.815565 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c3682-235e-49ae-b74a-7328c677e413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:37.815845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c3682-235e-49ae-b74a-7328c677e413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:37.908875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:37.938850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c3682-235e-49ae-b74a-7328c677e413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:37.941233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c3682-235e-49ae-b74a-7328c677e413 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:37.954961 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1119/2250] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:38.679286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4ca2f-e263-476a-aa90-acac2b5eaa27 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:38.681086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a0e4ca2f-e263-476a-aa90-acac2b5eaa27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:38.703121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4ca2f-e263-476a-aa90-acac2b5eaa27 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:38.712815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:38.714232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:38.715965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:38.716297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] PATH_INFO: `/v3/projects/29b76dafb1f241ae8adf2cefe1b33ea2` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:38.717870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b76dafb1f241ae8adf2cefe1b33ea2)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:38.720200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:38.794920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b76dafb1f241ae8adf2cefe1b33ea2', 'request_id': 'req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:38.810603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b76dafb1f241ae8adf2cefe1b33ea2', 'request_id': 'req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:38.821240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b76dafb1f241ae8adf2cefe1b33ea2', 'request_id': 'req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:38.830631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:38.850180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] The token cache is being invalidate because project 29b76dafb1f241ae8adf2cefe1b33ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:38.850609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:38.851602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a83ca5ea-6eb3-4b8a-89cf-b80d55adf762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:38.854019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1132/2251] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:38 2022] DELETE /identity/v3/projects/29b76dafb1f241ae8adf2cefe1b33ea2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:38.859213 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897e30e-c10f-4f40-859a-c3439c6c0d06 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:38.859654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897e30e-c10f-4f40-859a-c3439c6c0d06 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:38.859909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897e30e-c10f-4f40-859a-c3439c6c0d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:38.883330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c897e30e-c10f-4f40-859a-c3439c6c0d06 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:38.884694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c897e30e-c10f-4f40-859a-c3439c6c0d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:38.974756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1120/2252] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:58:38.976545 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fa921-a535-49ba-8303-0642a4ccf56d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:38.976839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fa921-a535-49ba-8303-0642a4ccf56d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:38.977117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fa921-a535-49ba-8303-0642a4ccf56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:38.997500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-277fa921-a535-49ba-8303-0642a4ccf56d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:38.998867 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-277fa921-a535-49ba-8303-0642a4ccf56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:39.020832 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1133/2253] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:39.024889 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897e30e-c10f-4f40-859a-c3439c6c0d06 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:39.035771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897e30e-c10f-4f40-859a-c3439c6c0d06 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:39.044378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6d093-b30b-45d9-a0f0-f733169a052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:39.045484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6d093-b30b-45d9-a0f0-f733169a052f admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:39.046027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6d093-b30b-45d9-a0f0-f733169a052f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:39.046312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6d093-b30b-45d9-a0f0-f733169a052f admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:39.047257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6d093-b30b-45d9-a0f0-f733169a052f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:39.047589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6d093-b30b-45d9-a0f0-f733169a052f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:39.051532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6d093-b30b-45d9-a0f0-f733169a052f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:39.076490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1121/2254] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:58:39.079841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fa921-a535-49ba-8303-0642a4ccf56d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:39.089306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fa921-a535-49ba-8303-0642a4ccf56d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:39.094259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b2a7b-b6c7-455f-b92e-aab95ca5a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:39.094932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2a7b-b6c7-455f-b92e-aab95ca5a522 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:39.095213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2a7b-b6c7-455f-b92e-aab95ca5a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:39.095484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2a7b-b6c7-455f-b92e-aab95ca5a522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:39.096185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b2a7b-b6c7-455f-b92e-aab95ca5a522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:39.098187 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b2a7b-b6c7-455f-b92e-aab95ca5a522 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:39.144300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1134/2255] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:39 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:39.147980 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6d093-b30b-45d9-a0f0-f733169a052f admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:39.160722 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6d093-b30b-45d9-a0f0-f733169a052f admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:39.246168 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b71a0e-f4f3-417f-ac1d-4fe4459c28f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:39.247187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71a0e-f4f3-417f-ac1d-4fe4459c28f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:39.247476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71a0e-f4f3-417f-ac1d-4fe4459c28f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:39.247775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71a0e-f4f3-417f-ac1d-4fe4459c28f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:39.248621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b71a0e-f4f3-417f-ac1d-4fe4459c28f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:39.250654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b71a0e-f4f3-417f-ac1d-4fe4459c28f7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:39.281639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1122/2256] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:39 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:39.283017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b2a7b-b6c7-455f-b92e-aab95ca5a522 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:39.295542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b2a7b-b6c7-455f-b92e-aab95ca5a522 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:39.307718 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fdcaa-93f9-4229-bd9d-94b3d3cfd8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:39.308488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fdcaa-93f9-4229-bd9d-94b3d3cfd8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:39.308872 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fdcaa-93f9-4229-bd9d-94b3d3cfd8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:39.309150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fdcaa-93f9-4229-bd9d-94b3d3cfd8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:39.309951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fdcaa-93f9-4229-bd9d-94b3d3cfd8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:39.311606 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fdcaa-93f9-4229-bd9d-94b3d3cfd8e4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:39.326478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1135/2257] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:39.328202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b71a0e-f4f3-417f-ac1d-4fe4459c28f7 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:39.343255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b71a0e-f4f3-417f-ac1d-4fe4459c28f7 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:39.349726 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0af8-1c7b-45e2-b475-42ad0c4112ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:39.353861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0af8-1c7b-45e2-b475-42ad0c4112ba admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:39.354190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0af8-1c7b-45e2-b475-42ad0c4112ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:39.354593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0af8-1c7b-45e2-b475-42ad0c4112ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:39.355624 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b0af8-1c7b-45e2-b475-42ad0c4112ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:39.357343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b0af8-1c7b-45e2-b475-42ad0c4112ba admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:39.370474 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1123/2258] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:39.375883 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fdcaa-93f9-4229-bd9d-94b3d3cfd8e4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:39.392897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fdcaa-93f9-4229-bd9d-94b3d3cfd8e4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:39.400499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988f450-ea95-4b8f-94f1-fc8a9eaf813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:39.401441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988f450-ea95-4b8f-94f1-fc8a9eaf813c admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:39.401723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988f450-ea95-4b8f-94f1-fc8a9eaf813c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:39.402214 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988f450-ea95-4b8f-94f1-fc8a9eaf813c admin admin] PATH_INFO: `/v3/projects/ea213667e9de4762833f21748bd0cffc/users/9e5c82efe5324b63bc75e53d476f88d5/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:39.421286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988f450-ea95-4b8f-94f1-fc8a9eaf813c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea213667e9de4762833f21748bd0cffc, user_id=9e5c82efe5324b63bc75e53d476f88d5, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:39.424645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988f450-ea95-4b8f-94f1-fc8a9eaf813c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:39.441851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1136/2259] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:39 2022] PUT /identity/v3/projects/ea213667e9de4762833f21748bd0cffc/users/9e5c82efe5324b63bc75e53d476f88d5/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:39.452792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9048b9-5c22-4225-acad-47958dfbf81a None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:39.452994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9048b9-5c22-4225-acad-47958dfbf81a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:39.453297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9048b9-5c22-4225-acad-47958dfbf81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:39.491034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-fd9048b9-5c22-4225-acad-47958dfbf81a None None] MFA Rules not processed for user `9e5c82efe5324b63bc75e53d476f88d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:39.492679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-fd9048b9-5c22-4225-acad-47958dfbf81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:39.547490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:39.583412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1124/2260] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:39.598762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988f450-ea95-4b8f-94f1-fc8a9eaf813c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:39.600895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6988f450-ea95-4b8f-94f1-fc8a9eaf813c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:39.723889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988f450-ea95-4b8f-94f1-fc8a9eaf813c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:39.730878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f6026-7cf7-4798-864b-7c9679719935 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9c1cc51e544c90a629feb312a80c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:39.732151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f6026-7cf7-4798-864b-7c9679719935 service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:39.732716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f6026-7cf7-4798-864b-7c9679719935 service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:39.733251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f6026-7cf7-4798-864b-7c9679719935 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:39.748975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f6026-7cf7-4798-864b-7c9679719935 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:39.750920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f6026-7cf7-4798-864b-7c9679719935 service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:39.768834 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1137/2261] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:42.969697 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa8aac-92a5-46ac-8e73-b0e4628916fc None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:42.970323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa8aac-92a5-46ac-8e73-b0e4628916fc None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:42.970682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa8aac-92a5-46ac-8e73-b0e4628916fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.013914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-26aa8aac-92a5-46ac-8e73-b0e4628916fc None None] MFA Rules not processed for user `8b5c7c777ed84477b3e3afe408694768`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:43.013914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-26aa8aac-92a5-46ac-8e73-b0e4628916fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.162017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1125/2262] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:43.170886 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f6026-7cf7-4798-864b-7c9679719935 service glance] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:43.172368 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-652f6026-7cf7-4798-864b-7c9679719935 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.263184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:43.305728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f6026-7cf7-4798-864b-7c9679719935 service glance] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:43.313614 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02fd4c-0486-4d21-8bc6-969991f64629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:43.314847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02fd4c-0486-4d21-8bc6-969991f64629 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.315130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02fd4c-0486-4d21-8bc6-969991f64629 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.315402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02fd4c-0486-4d21-8bc6-969991f64629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.319775 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6b02fd4c-0486-4d21-8bc6-969991f64629 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.414351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02fd4c-0486-4d21-8bc6-969991f64629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:43.416054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02fd4c-0486-4d21-8bc6-969991f64629 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.426589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1138/2263] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:44.537326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db32a4e-8739-4b5a-886b-2922f7191c5a None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:44.538052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db32a4e-8739-4b5a-886b-2922f7191c5a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:44.538052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db32a4e-8739-4b5a-886b-2922f7191c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:44.556391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-0db32a4e-8739-4b5a-886b-2922f7191c5a None None] MFA Rules not processed for user `d215812d468540c199503d16357cf4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:44.557639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0db32a4e-8739-4b5a-886b-2922f7191c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:44.565801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1126/2264] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:58:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:53.421602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=35 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:54.550698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=46 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:20.755151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02fd4c-0486-4d21-8bc6-969991f64629 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:20.841923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02fd4c-0486-4d21-8bc6-969991f64629 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:20.846476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:20.847373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:20.847664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:20.847935 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] PATH_INFO: `/v3/users/9e5c82efe5324b63bc75e53d476f88d5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:20.849133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5c82efe5324b63bc75e53d476f88d5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:20.851084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:20.906469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5c82efe5324b63bc75e53d476f88d5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:20.907114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5c82efe5324b63bc75e53d476f88d5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:20.907719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5c82efe5324b63bc75e53d476f88d5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:20.916059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5c82efe5324b63bc75e53d476f88d5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:20.924817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5c82efe5324b63bc75e53d476f88d5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:20.943830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1139/2265] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:59:20 2022] DELETE /identity/v3/users/9e5c82efe5324b63bc75e53d476f88d5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:59:20.950267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee3f79-cdd3-44b4-9e58-b32c269ef0f7 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:20.950267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee3f79-cdd3-44b4-9e58-b32c269ef0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:20.950267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee3f79-cdd3-44b4-9e58-b32c269ef0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:20.967765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-7cee3f79-cdd3-44b4-9e58-b32c269ef0f7 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:20.968994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7cee3f79-cdd3-44b4-9e58-b32c269ef0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:21.035836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1127/2266] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:21.046912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:21.048331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:21.132301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5c087-7a70-4f4d-8056-30396a96d83a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:21.137134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85c99d-c999-4888-83c6-1bbae8377793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:21.138177 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85c99d-c999-4888-83c6-1bbae8377793 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:21.138683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85c99d-c999-4888-83c6-1bbae8377793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:21.138882 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85c99d-c999-4888-83c6-1bbae8377793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:21.148960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85c99d-c999-4888-83c6-1bbae8377793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:21.150645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85c99d-c999-4888-83c6-1bbae8377793 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:21.161515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1140/2267] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:59:21.461392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee3f79-cdd3-44b4-9e58-b32c269ef0f7 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:21.462934 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7cee3f79-cdd3-44b4-9e58-b32c269ef0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:21.477480 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee3f79-cdd3-44b4-9e58-b32c269ef0f7 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:21.484294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:21.485345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:21.485637 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:21.485953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] PATH_INFO: `/v3/projects/ea213667e9de4762833f21748bd0cffc` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:21.487203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea213667e9de4762833f21748bd0cffc)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:21.489186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:21.540340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea213667e9de4762833f21748bd0cffc', 'request_id': 'req-9cfb0932-404d-4651-a2b1-cb090817e772'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:21.549056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea213667e9de4762833f21748bd0cffc', 'request_id': 'req-9cfb0932-404d-4651-a2b1-cb090817e772'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:21.555645 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea213667e9de4762833f21748bd0cffc', 'request_id': 'req-9cfb0932-404d-4651-a2b1-cb090817e772'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:21.567580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] The token cache is being invalidate because project ea213667e9de4762833f21748bd0cffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:59:21.567890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:21.568585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cfb0932-404d-4651-a2b1-cb090817e772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:21.570214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1128/2268] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:59:21 2022] DELETE /identity/v3/projects/ea213667e9de4762833f21748bd0cffc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:59:21.575359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136e01-5376-4103-ae71-850c2f04f593 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:21.575675 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136e01-5376-4103-ae71-850c2f04f593 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:21.575950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136e01-5376-4103-ae71-850c2f04f593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:21.593666 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fa136e01-5376-4103-ae71-850c2f04f593 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:21.595019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fa136e01-5376-4103-ae71-850c2f04f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:21.617183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:21.659890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1141/2269] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:21.669656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669dc0d-2bd5-4cc8-b4e9-7c837751b89b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:21.669980 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669dc0d-2bd5-4cc8-b4e9-7c837751b89b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:21.670262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669dc0d-2bd5-4cc8-b4e9-7c837751b89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:21.689422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a669dc0d-2bd5-4cc8-b4e9-7c837751b89b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:21.690741 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a669dc0d-2bd5-4cc8-b4e9-7c837751b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:21.699372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1129/2270] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:21.703686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa136e01-5376-4103-ae71-850c2f04f593 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:21.713799 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa136e01-5376-4103-ae71-850c2f04f593 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:21.718951 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83da15-0d1c-4c6a-bfaa-10bdb62f09bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:21.719687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83da15-0d1c-4c6a-bfaa-10bdb62f09bc admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:21.719966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83da15-0d1c-4c6a-bfaa-10bdb62f09bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:21.720244 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83da15-0d1c-4c6a-bfaa-10bdb62f09bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:21.720966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83da15-0d1c-4c6a-bfaa-10bdb62f09bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:59:21.721273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83da15-0d1c-4c6a-bfaa-10bdb62f09bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:21.722904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83da15-0d1c-4c6a-bfaa-10bdb62f09bc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:21.735846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1142/2271] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 14:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:59:21.740186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669dc0d-2bd5-4cc8-b4e9-7c837751b89b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:21.750842 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669dc0d-2bd5-4cc8-b4e9-7c837751b89b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:21.755900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d593f-efe0-47c6-9f37-a72e8ae0d5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:21.756566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d593f-efe0-47c6-9f37-a72e8ae0d5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:21.756848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d593f-efe0-47c6-9f37-a72e8ae0d5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:21.757124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d593f-efe0-47c6-9f37-a72e8ae0d5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:21.757829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d593f-efe0-47c6-9f37-a72e8ae0d5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:21.759830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d593f-efe0-47c6-9f37-a72e8ae0d5e6 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:21.785978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1130/2272] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 14:59:21 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:59:21.790135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83da15-0d1c-4c6a-bfaa-10bdb62f09bc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:21.801345 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83da15-0d1c-4c6a-bfaa-10bdb62f09bc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:21.860361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf495d6-8441-471f-8d0a-f00e855f7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:21.861063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf495d6-8441-471f-8d0a-f00e855f7b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:21.861343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf495d6-8441-471f-8d0a-f00e855f7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:21.861623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf495d6-8441-471f-8d0a-f00e855f7b3e admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:21.862354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf495d6-8441-471f-8d0a-f00e855f7b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:21.864270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf495d6-8441-471f-8d0a-f00e855f7b3e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:21.887796 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1143/2273] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 14:59:21 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:59:21.889059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d593f-efe0-47c6-9f37-a72e8ae0d5e6 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:21.899646 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d593f-efe0-47c6-9f37-a72e8ae0d5e6 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:21.905161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816188f0-8197-4d78-bf49-89e347c7207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:21.905857 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816188f0-8197-4d78-bf49-89e347c7207d admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:21.906175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816188f0-8197-4d78-bf49-89e347c7207d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:21.906450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816188f0-8197-4d78-bf49-89e347c7207d admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:21.907267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816188f0-8197-4d78-bf49-89e347c7207d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:21.908856 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816188f0-8197-4d78-bf49-89e347c7207d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:21.922763 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1131/2274] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:59:21.926711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf495d6-8441-471f-8d0a-f00e855f7b3e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:21.938808 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf495d6-8441-471f-8d0a-f00e855f7b3e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:21.943642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85342ed9-2abd-4706-a930-a744a1e99b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:21.944299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85342ed9-2abd-4706-a930-a744a1e99b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:21.944580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85342ed9-2abd-4706-a930-a744a1e99b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:21.944846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85342ed9-2abd-4706-a930-a744a1e99b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:21.945588 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85342ed9-2abd-4706-a930-a744a1e99b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:21.947371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85342ed9-2abd-4706-a930-a744a1e99b46 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:21.957784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1144/2275] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:59:21.962215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816188f0-8197-4d78-bf49-89e347c7207d admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:21.973431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816188f0-8197-4d78-bf49-89e347c7207d admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:21.978293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d077a13-4db3-4b62-a40d-7098f12cc06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:21.979744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d077a13-4db3-4b62-a40d-7098f12cc06a admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:21.980026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d077a13-4db3-4b62-a40d-7098f12cc06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:21.980302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d077a13-4db3-4b62-a40d-7098f12cc06a admin admin] PATH_INFO: `/v3/projects/a36f27690dd84dc7b6c400ff0f963b53/users/a379b0ae72534e8f8cc0bc0d3b55c34e/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:21.997395 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d077a13-4db3-4b62-a40d-7098f12cc06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36f27690dd84dc7b6c400ff0f963b53, user_id=a379b0ae72534e8f8cc0bc0d3b55c34e, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:22.000133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d077a13-4db3-4b62-a40d-7098f12cc06a admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:22.017613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1132/2276] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 14:59:21 2022] PUT /identity/v3/projects/a36f27690dd84dc7b6c400ff0f963b53/users/a379b0ae72534e8f8cc0bc0d3b55c34e/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:59:22.029760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d120e6d-047e-429e-8354-b80b439b0372 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:22.030101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d120e6d-047e-429e-8354-b80b439b0372 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:22.030387 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d120e6d-047e-429e-8354-b80b439b0372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:22.058003 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5d120e6d-047e-429e-8354-b80b439b0372 None None] MFA Rules not processed for user `a379b0ae72534e8f8cc0bc0d3b55c34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:22.059616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5d120e6d-047e-429e-8354-b80b439b0372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:22.128020 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1145/2277] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:22.139713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d077a13-4db3-4b62-a40d-7098f12cc06a admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:22.141803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1d077a13-4db3-4b62-a40d-7098f12cc06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:22.164071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:22.213802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d077a13-4db3-4b62-a40d-7098f12cc06a admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:22.217393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba150a7e-f94d-40ba-a8bc-76a7d79bef06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:22.218093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba150a7e-f94d-40ba-a8bc-76a7d79bef06 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:22.218377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba150a7e-f94d-40ba-a8bc-76a7d79bef06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:22.218653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba150a7e-f94d-40ba-a8bc-76a7d79bef06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:22.227712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba150a7e-f94d-40ba-a8bc-76a7d79bef06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:22.229992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba150a7e-f94d-40ba-a8bc-76a7d79bef06 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:22.240743 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1133/2278] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:59:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:59:24.687076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764ec71-6b7b-4b47-a839-a1e9d6dd4929 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:24.687602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764ec71-6b7b-4b47-a839-a1e9d6dd4929 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:24.687602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764ec71-6b7b-4b47-a839-a1e9d6dd4929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:24.706876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3764ec71-6b7b-4b47-a839-a1e9d6dd4929 None None] MFA Rules not processed for user `a379b0ae72534e8f8cc0bc0d3b55c34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:24.708101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3764ec71-6b7b-4b47-a839-a1e9d6dd4929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:24.716055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1146/2279] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:59:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:32.235836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=17 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:34.701155 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:37.231429 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba150a7e-f94d-40ba-a8bc-76a7d79bef06 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:37.232852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ba150a7e-f94d-40ba-a8bc-76a7d79bef06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:37.302478 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba150a7e-f94d-40ba-a8bc-76a7d79bef06 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:37.306862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc431df-857d-41dd-b252-68b293e6ab92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:37.307352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc431df-857d-41dd-b252-68b293e6ab92 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:37.307638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc431df-857d-41dd-b252-68b293e6ab92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:37.307925 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc431df-857d-41dd-b252-68b293e6ab92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:37.310047 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4dc431df-857d-41dd-b252-68b293e6ab92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:37.389529 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc431df-857d-41dd-b252-68b293e6ab92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:37.391021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc431df-857d-41dd-b252-68b293e6ab92 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:37.402491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1134/2280] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:59:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:59:47.396794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=50 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:51.654393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356d9af-bc95-4414-a21c-90cc8ec4ab92 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:51.655023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356d9af-bc95-4414-a21c-90cc8ec4ab92 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:51.655023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356d9af-bc95-4414-a21c-90cc8ec4ab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:51.716070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e356d9af-bc95-4414-a21c-90cc8ec4ab92 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:51.717270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e356d9af-bc95-4414-a21c-90cc8ec4ab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:51.785720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1147/2281] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:51.828268 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc431df-857d-41dd-b252-68b293e6ab92 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:51.830796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4dc431df-857d-41dd-b252-68b293e6ab92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:51.933218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc431df-857d-41dd-b252-68b293e6ab92 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:51.941790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d07e2d-a49e-481a-a033-6aa3d475fefe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:51.942662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07e2d-a49e-481a-a033-6aa3d475fefe service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:51.942945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07e2d-a49e-481a-a033-6aa3d475fefe service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:51.943349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07e2d-a49e-481a-a033-6aa3d475fefe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:51.958192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d07e2d-a49e-481a-a033-6aa3d475fefe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:51.960076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d07e2d-a49e-481a-a033-6aa3d475fefe service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:51.971747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1135/2282] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 14:59:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 14:59:52.635778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42d4cc-f4e6-4925-9fa8-c1036d2a76c4 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:52.636069 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42d4cc-f4e6-4925-9fa8-c1036d2a76c4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:52.636349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42d4cc-f4e6-4925-9fa8-c1036d2a76c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:52.661629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-de42d4cc-f4e6-4925-9fa8-c1036d2a76c4 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:52.663048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-de42d4cc-f4e6-4925-9fa8-c1036d2a76c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:52.671957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1148/2283] 10.222.0.81 () {58 vars in 967 bytes} [Thu Jun 16 14:59:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:52.685276 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d07e2d-a49e-481a-a033-6aa3d475fefe service swift] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:52.696034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d07e2d-a49e-481a-a033-6aa3d475fefe service swift] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:52.702072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e4943-09ba-4e78-8552-d53637490ff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:52.702721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e4943-09ba-4e78-8552-d53637490ff8 service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:52.703002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e4943-09ba-4e78-8552-d53637490ff8 service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:52.703266 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e4943-09ba-4e78-8552-d53637490ff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:52.712356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e4943-09ba-4e78-8552-d53637490ff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:52.714328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e4943-09ba-4e78-8552-d53637490ff8 service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:52.722780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1136/2284] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 14:59:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 14:59:52.968925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea3f3d-0326-4baa-9504-bb735a8fe37a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:52.969208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea3f3d-0326-4baa-9504-bb735a8fe37a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:52.970042 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea3f3d-0326-4baa-9504-bb735a8fe37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:52.988859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-65ea3f3d-0326-4baa-9504-bb735a8fe37a None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:52.990113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-65ea3f3d-0326-4baa-9504-bb735a8fe37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:52.998203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1149/2285] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 14:59:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:53.011315 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e4943-09ba-4e78-8552-d53637490ff8 service swift] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:53.022548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e4943-09ba-4e78-8552-d53637490ff8 service swift] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:53.028449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cce736-e66b-4476-91b1-83f51bbe1d89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:53.029143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cce736-e66b-4476-91b1-83f51bbe1d89 service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:53.029428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cce736-e66b-4476-91b1-83f51bbe1d89 service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:53.029673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cce736-e66b-4476-91b1-83f51bbe1d89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:53.038670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cce736-e66b-4476-91b1-83f51bbe1d89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:53.040587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cce736-e66b-4476-91b1-83f51bbe1d89 service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:53.049100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1137/2286] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 14:59:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 14:59:53.415927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab565b5-13e3-4a02-83e7-3c7ae8c09147 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:53.416461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab565b5-13e3-4a02-83e7-3c7ae8c09147 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:53.418113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab565b5-13e3-4a02-83e7-3c7ae8c09147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:53.440143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cab565b5-13e3-4a02-83e7-3c7ae8c09147 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:53.441383 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cab565b5-13e3-4a02-83e7-3c7ae8c09147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:53.456802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff638a2e-4e33-41fd-82f3-c8f11865f28e None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:53.457097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff638a2e-4e33-41fd-82f3-c8f11865f28e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:53.457379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff638a2e-4e33-41fd-82f3-c8f11865f28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:53.458971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1150/2287] 10.222.0.81 () {58 vars in 967 bytes} [Thu Jun 16 14:59:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:59:53.471990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab565b5-13e3-4a02-83e7-3c7ae8c09147 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:53.475578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ff638a2e-4e33-41fd-82f3-c8f11865f28e None None] MFA Rules not processed for user `7efff0603fb7461ca799c67a8050e181`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:53.476783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ff638a2e-4e33-41fd-82f3-c8f11865f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:53.484606 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab565b5-13e3-4a02-83e7-3c7ae8c09147 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:53.489736 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492674ad-fc22-41a2-89b9-536c65cf07f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:53.490418 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492674ad-fc22-41a2-89b9-536c65cf07f7 service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:53.490705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492674ad-fc22-41a2-89b9-536c65cf07f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:53.490980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492674ad-fc22-41a2-89b9-536c65cf07f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:53.500536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492674ad-fc22-41a2-89b9-536c65cf07f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:53.502168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492674ad-fc22-41a2-89b9-536c65cf07f7 service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:53.512106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1151/2288] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 14:59:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 14:59:53.536597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1138/2289] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:59:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:59:55.806739 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492674ad-fc22-41a2-89b9-536c65cf07f7 service swift] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:55.873109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492674ad-fc22-41a2-89b9-536c65cf07f7 service swift] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:55.877721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:55.878634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:55.878918 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:55.879195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] PATH_INFO: `/v3/users/a379b0ae72534e8f8cc0bc0d3b55c34e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:55.880391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a379b0ae72534e8f8cc0bc0d3b55c34e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:55.882360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:55.920412 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:55.935809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a379b0ae72534e8f8cc0bc0d3b55c34e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:55.936454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a379b0ae72534e8f8cc0bc0d3b55c34e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:55.937056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a379b0ae72534e8f8cc0bc0d3b55c34e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:55.944789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a379b0ae72534e8f8cc0bc0d3b55c34e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:55.952578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a379b0ae72534e8f8cc0bc0d3b55c34e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:55.973398 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1152/2290] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 14:59:55 2022] DELETE /identity/v3/users/a379b0ae72534e8f8cc0bc0d3b55c34e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:59:55.978742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fe16b-462a-4e61-b46b-d45ce0847783 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:55.979257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fe16b-462a-4e61-b46b-d45ce0847783 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:55.979380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fe16b-462a-4e61-b46b-d45ce0847783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:55.997864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-050fe16b-462a-4e61-b46b-d45ce0847783 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:55.999095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-050fe16b-462a-4e61-b46b-d45ce0847783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:56.047420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:56.063771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1139/2291] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:59:56.074127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:56.075562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:56.134408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31428-3f0a-4c2e-ad69-05843d56054d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:56.138439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbaad2-5850-4324-9340-98c11174121f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:56.139090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbaad2-5850-4324-9340-98c11174121f service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:56.139371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbaad2-5850-4324-9340-98c11174121f service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:56.139646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbaad2-5850-4324-9340-98c11174121f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:56.149531 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbaad2-5850-4324-9340-98c11174121f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:56.151150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbaad2-5850-4324-9340-98c11174121f service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:56.161185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1153/2292] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 14:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:59:56.335043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fe16b-462a-4e61-b46b-d45ce0847783 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:56.337145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-050fe16b-462a-4e61-b46b-d45ce0847783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:56.351292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fe16b-462a-4e61-b46b-d45ce0847783 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:56.356927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:56.357796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:56.358103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:56.358376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] PATH_INFO: `/v3/projects/a36f27690dd84dc7b6c400ff0f963b53` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:56.359951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36f27690dd84dc7b6c400ff0f963b53)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:56.361868 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:56.413633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36f27690dd84dc7b6c400ff0f963b53', 'request_id': 'req-4bddc114-b60c-4869-b20b-be7464e43ca4'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:56.421822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36f27690dd84dc7b6c400ff0f963b53', 'request_id': 'req-4bddc114-b60c-4869-b20b-be7464e43ca4'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:56.428319 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36f27690dd84dc7b6c400ff0f963b53', 'request_id': 'req-4bddc114-b60c-4869-b20b-be7464e43ca4'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:56.438550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] The token cache is being invalidate because project a36f27690dd84dc7b6c400ff0f963b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:59:56.438835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:56.439466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:56.441088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1140/2293] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 14:59:56 2022] DELETE /identity/v3/projects/a36f27690dd84dc7b6c400ff0f963b53 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:59:58.348599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17b6a-61c5-4947-9ed1-3d78a968bf17 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:58.349359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17b6a-61c5-4947-9ed1-3d78a968bf17 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:58.349359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17b6a-61c5-4947-9ed1-3d78a968bf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:58.371757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-70c17b6a-61c5-4947-9ed1-3d78a968bf17 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:58.372983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-70c17b6a-61c5-4947-9ed1-3d78a968bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:58.438981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1154/2294] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 14:59:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:58.451715 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:58.453154 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:58.543878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddc114-b60c-4869-b20b-be7464e43ca4 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:58.552750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761060db-bde4-40f5-bf98-e4f1ce8eefb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:58.553876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761060db-bde4-40f5-bf98-e4f1ce8eefb4 service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:58.554519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761060db-bde4-40f5-bf98-e4f1ce8eefb4 service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:58.555062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761060db-bde4-40f5-bf98-e4f1ce8eefb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:58.569422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761060db-bde4-40f5-bf98-e4f1ce8eefb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:58.571515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761060db-bde4-40f5-bf98-e4f1ce8eefb4 service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:58.582535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1141/2295] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 14:59:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:00:08.431793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=68,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:08.578021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=64,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:20.060950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c0531-61ad-4333-a20c-e02bccde1ca1 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:20.061532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c0531-61ad-4333-a20c-e02bccde1ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:20.061532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c0531-61ad-4333-a20c-e02bccde1ca1 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:20.063196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1155/2296] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 15:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:00:20.069768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b76fb9-d1a7-46ff-be4a-2c481af5c9fb None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:20.070454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b76fb9-d1a7-46ff-be4a-2c481af5c9fb None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:20.070454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b76fb9-d1a7-46ff-be4a-2c481af5c9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:20.110216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-e8b76fb9-d1a7-46ff-be4a-2c481af5c9fb None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:20.111479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e8b76fb9-d1a7-46ff-be4a-2c481af5c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:20.185358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1142/2297] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:00:20.197648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c0531-61ad-4333-a20c-e02bccde1ca1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:20.199974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fa7c0531-61ad-4333-a20c-e02bccde1ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:20.259512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c0531-61ad-4333-a20c-e02bccde1ca1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:20.264349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d599ec3-e434-4c0d-9abe-092b6b90c27a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9c1cc51e544c90a629feb312a80c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:20.265027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d599ec3-e434-4c0d-9abe-092b6b90c27a service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:20.265285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d599ec3-e434-4c0d-9abe-092b6b90c27a service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:20.265560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d599ec3-e434-4c0d-9abe-092b6b90c27a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:20.276484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d599ec3-e434-4c0d-9abe-092b6b90c27a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:20.277947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d599ec3-e434-4c0d-9abe-092b6b90c27a service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:20.290098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1156/2298] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:00:20.360798 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2c2a7-b848-420e-8829-b23b7773680e None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:20.361087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2c2a7-b848-420e-8829-b23b7773680e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:20.361372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2c2a7-b848-420e-8829-b23b7773680e None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:20.363478 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1143/2299] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 15:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:00:20.367971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd99524-09e0-469c-92c3-0fa6885891bb None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:20.369297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd99524-09e0-469c-92c3-0fa6885891bb None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:20.370643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd99524-09e0-469c-92c3-0fa6885891bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:20.393711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7cd99524-09e0-469c-92c3-0fa6885891bb None None] MFA Rules not processed for user `8940bddd49534f01a8b1bf1dee644216`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:20.394960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7cd99524-09e0-469c-92c3-0fa6885891bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:20.453159 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1157/2300] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:00:20.466194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2c2a7-b848-420e-8829-b23b7773680e None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:20.467965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-efa2c2a7-b848-420e-8829-b23b7773680e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:20.483698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2c2a7-b848-420e-8829-b23b7773680e None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:20.487609 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b89d6-55ea-416e-b6c6-2fba5b5c869f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:20.488376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b89d6-55ea-416e-b6c6-2fba5b5c869f service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:20.488591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b89d6-55ea-416e-b6c6-2fba5b5c869f service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:20.489299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b89d6-55ea-416e-b6c6-2fba5b5c869f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:20.497298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b89d6-55ea-416e-b6c6-2fba5b5c869f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:20.498787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b89d6-55ea-416e-b6c6-2fba5b5c869f service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:20.508175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1144/2301] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:00:20.597934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2bdcf-a31c-4084-b12d-c03d0f63350f None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:20.598246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2bdcf-a31c-4084-b12d-c03d0f63350f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:20.598532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2bdcf-a31c-4084-b12d-c03d0f63350f None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:20.599929 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1158/2302] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 15:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:00:20.610998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8e768-eeb0-4b8b-aab7-b008a8a0e688 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:20.611376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8e768-eeb0-4b8b-aab7-b008a8a0e688 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:20.611663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8e768-eeb0-4b8b-aab7-b008a8a0e688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:20.631295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b5f8e768-eeb0-4b8b-aab7-b008a8a0e688 None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:20.633120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b5f8e768-eeb0-4b8b-aab7-b008a8a0e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:20.643041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1145/2303] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:00:20.654379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2bdcf-a31c-4084-b12d-c03d0f63350f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:20.666130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2bdcf-a31c-4084-b12d-c03d0f63350f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:20.669779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42415ce-8630-4973-8ee8-146535cdceef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:20.670457 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42415ce-8630-4973-8ee8-146535cdceef service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:20.670744 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42415ce-8630-4973-8ee8-146535cdceef service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:20.671021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42415ce-8630-4973-8ee8-146535cdceef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:20.682066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42415ce-8630-4973-8ee8-146535cdceef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:20.683493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42415ce-8630-4973-8ee8-146535cdceef service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:20.695854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1159/2304] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:00:23.565125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff9ae8-40a1-4a97-aa44-a8ffb8a0034b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:23.565617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff9ae8-40a1-4a97-aa44-a8ffb8a0034b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:23.565710 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff9ae8-40a1-4a97-aa44-a8ffb8a0034b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:23.585544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-69ff9ae8-40a1-4a97-aa44-a8ffb8a0034b None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:23.586857 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-69ff9ae8-40a1-4a97-aa44-a8ffb8a0034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:23.594841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1146/2305] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:00:23.606661 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42415ce-8630-4973-8ee8-146535cdceef service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:23.619447 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42415ce-8630-4973-8ee8-146535cdceef service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:23.625427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2bce3-082b-42ba-909f-fe9b52ebe981 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:23.626370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2bce3-082b-42ba-909f-fe9b52ebe981 service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:23.626703 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2bce3-082b-42ba-909f-fe9b52ebe981 service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:23.627083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2bce3-082b-42ba-909f-fe9b52ebe981 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:23.638599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2bce3-082b-42ba-909f-fe9b52ebe981 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:23.640423 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2bce3-082b-42ba-909f-fe9b52ebe981 service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:23.652328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1160/2306] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 15:00:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:00:27.451539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff9ae8-40a1-4a97-aa44-a8ffb8a0034b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:27.463393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff9ae8-40a1-4a97-aa44-a8ffb8a0034b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:27.465701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8769306-8b8a-43e6-932e-111c55610ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:27.466401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8769306-8b8a-43e6-932e-111c55610ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:27.466685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8769306-8b8a-43e6-932e-111c55610ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:27.466978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8769306-8b8a-43e6-932e-111c55610ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:27.468799 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a8769306-8b8a-43e6-932e-111c55610ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:27.483520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8769306-8b8a-43e6-932e-111c55610ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:27.484966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8769306-8b8a-43e6-932e-111c55610ec0 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:27.497657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1147/2307] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:00:28.723597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2bce3-082b-42ba-909f-fe9b52ebe981 service swift] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:28.725337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-35b2bce3-082b-42ba-909f-fe9b52ebe981 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:28.738523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2bce3-082b-42ba-909f-fe9b52ebe981 service swift] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:28.742299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f6042-2c4c-4ead-b6bf-ffb494733e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:28.742955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f6042-2c4c-4ead-b6bf-ffb494733e4d service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:28.743231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f6042-2c4c-4ead-b6bf-ffb494733e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:28.743503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f6042-2c4c-4ead-b6bf-ffb494733e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:28.745298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c66f6042-2c4c-4ead-b6bf-ffb494733e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:28.760426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f6042-2c4c-4ead-b6bf-ffb494733e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:28.762726 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f6042-2c4c-4ead-b6bf-ffb494733e4d service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:28.778442 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1161/2308] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:00:37.491595 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=55 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:38.771014 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=67 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:44.308463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8769306-8b8a-43e6-932e-111c55610ec0 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:44.310410 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a8769306-8b8a-43e6-932e-111c55610ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:44.324465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8769306-8b8a-43e6-932e-111c55610ec0 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:44.330210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4951a8-8f69-4758-a104-d2b0653f3207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:44.330861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4951a8-8f69-4758-a104-d2b0653f3207 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:44.331151 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4951a8-8f69-4758-a104-d2b0653f3207 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:44.331426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4951a8-8f69-4758-a104-d2b0653f3207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:44.333161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8b4951a8-8f69-4758-a104-d2b0653f3207 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:44.392765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4951a8-8f69-4758-a104-d2b0653f3207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:44.394394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4951a8-8f69-4758-a104-d2b0653f3207 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:44.403599 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1148/2309] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:00:54.399400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=28 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:54.496328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bed9fc-56ca-4ea3-bfd8-393b4ca909ef None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:54.496829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bed9fc-56ca-4ea3-bfd8-393b4ca909ef None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:54.496934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bed9fc-56ca-4ea3-bfd8-393b4ca909ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:54.517070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-99bed9fc-56ca-4ea3-bfd8-393b4ca909ef None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:54.518519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-99bed9fc-56ca-4ea3-bfd8-393b4ca909ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:54.527833 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1162/2310] 10.222.0.81 () {58 vars in 967 bytes} [Thu Jun 16 15:00:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:00:54.551296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4951a8-8f69-4758-a104-d2b0653f3207 service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:54.564929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4951a8-8f69-4758-a104-d2b0653f3207 service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:54.572890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa212a26-ee9e-410d-8876-f89172e30f0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:54.573583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa212a26-ee9e-410d-8876-f89172e30f0f service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:54.573837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa212a26-ee9e-410d-8876-f89172e30f0f service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:54.574144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa212a26-ee9e-410d-8876-f89172e30f0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:54.586903 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa212a26-ee9e-410d-8876-f89172e30f0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:54.588497 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa212a26-ee9e-410d-8876-f89172e30f0f service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:54.599738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1149/2311] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 15:00:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:00:57.006678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bed9fc-56ca-4ea3-bfd8-393b4ca909ef None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:57.021348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bed9fc-56ca-4ea3-bfd8-393b4ca909ef None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:57.027399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecda0f-72be-4f88-a76a-d1f493a4ee43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:57.028060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecda0f-72be-4f88-a76a-d1f493a4ee43 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:57.028342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecda0f-72be-4f88-a76a-d1f493a4ee43 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:57.028672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecda0f-72be-4f88-a76a-d1f493a4ee43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:57.030500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fcecda0f-72be-4f88-a76a-d1f493a4ee43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:57.101124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecda0f-72be-4f88-a76a-d1f493a4ee43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:57.102834 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecda0f-72be-4f88-a76a-d1f493a4ee43 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:57.112337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1163/2312] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:00.830835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa212a26-ee9e-410d-8876-f89172e30f0f service swift] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:00.845827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa212a26-ee9e-410d-8876-f89172e30f0f service swift] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:00.850184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e904b2-d9d7-4aaa-aac3-881aa65eee7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:00.850973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e904b2-d9d7-4aaa-aac3-881aa65eee7f service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:00.851259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e904b2-d9d7-4aaa-aac3-881aa65eee7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:00.851579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e904b2-d9d7-4aaa-aac3-881aa65eee7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:00.853412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a8e904b2-d9d7-4aaa-aac3-881aa65eee7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:00.864215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e904b2-d9d7-4aaa-aac3-881aa65eee7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:00.866963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e904b2-d9d7-4aaa-aac3-881aa65eee7f service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:00.879202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1150/2313] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:01:07.108007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=31 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:10.874172 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=12 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:24.913761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728669bf-4c39-4f3f-a6bc-91c4364d988e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:24.914549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728669bf-4c39-4f3f-a6bc-91c4364d988e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:24.914549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728669bf-4c39-4f3f-a6bc-91c4364d988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:24.941130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-728669bf-4c39-4f3f-a6bc-91c4364d988e None None] MFA Rules not processed for user `555dc188a72647f3af56b774d04ab4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:24.942415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-728669bf-4c39-4f3f-a6bc-91c4364d988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:24.949692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1164/2314] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:01:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:01:32.806618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e904b2-d9d7-4aaa-aac3-881aa65eee7f service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:32.825312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e904b2-d9d7-4aaa-aac3-881aa65eee7f service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:32.831891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f225c8-4195-4a3a-bbb3-bbeb9b21ee4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:32.832794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f225c8-4195-4a3a-bbb3-bbeb9b21ee4d service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:32.833294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f225c8-4195-4a3a-bbb3-bbeb9b21ee4d service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:32.833822 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f225c8-4195-4a3a-bbb3-bbeb9b21ee4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:32.836954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-40f225c8-4195-4a3a-bbb3-bbeb9b21ee4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:32.853762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f225c8-4195-4a3a-bbb3-bbeb9b21ee4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:32.855414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f225c8-4195-4a3a-bbb3-bbeb9b21ee4d service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:32.868778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1151/2315] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:01:34.935889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:41.500662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728669bf-4c39-4f3f-a6bc-91c4364d988e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:41.514968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728669bf-4c39-4f3f-a6bc-91c4364d988e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:41.520416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d5716-5fe4-44f8-86e3-e511088a9d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:41.521226 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d5716-5fe4-44f8-86e3-e511088a9d7a service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:41.521519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d5716-5fe4-44f8-86e3-e511088a9d7a service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:41.521794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d5716-5fe4-44f8-86e3-e511088a9d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:41.523746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f39d5716-5fe4-44f8-86e3-e511088a9d7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:41.587569 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d5716-5fe4-44f8-86e3-e511088a9d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:41.589160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d5716-5fe4-44f8-86e3-e511088a9d7a service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:41.599650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1165/2316] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:42.862827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=6 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:51.594520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=28 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:29.408031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f225c8-4195-4a3a-bbb3-bbeb9b21ee4d service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:29.409600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-40f225c8-4195-4a3a-bbb3-bbeb9b21ee4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:29.424312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f225c8-4195-4a3a-bbb3-bbeb9b21ee4d service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:29.430327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e579ef-f5bf-4144-becd-57b2bebd706b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:29.430986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e579ef-f5bf-4144-becd-57b2bebd706b service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:29.431264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e579ef-f5bf-4144-becd-57b2bebd706b service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:29.431541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e579ef-f5bf-4144-becd-57b2bebd706b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:29.433335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d8e579ef-f5bf-4144-becd-57b2bebd706b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:29.494374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e579ef-f5bf-4144-becd-57b2bebd706b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:29.495850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e579ef-f5bf-4144-becd-57b2bebd706b service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:29.505290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1152/2317] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:35.929636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d5716-5fe4-44f8-86e3-e511088a9d7a service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:35.947559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d5716-5fe4-44f8-86e3-e511088a9d7a service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:35.956967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca07b14-7a97-4054-8fe9-c6597671ad67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:35.958090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca07b14-7a97-4054-8fe9-c6597671ad67 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:35.958609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca07b14-7a97-4054-8fe9-c6597671ad67 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:35.959831 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca07b14-7a97-4054-8fe9-c6597671ad67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:35.963109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1ca07b14-7a97-4054-8fe9-c6597671ad67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:35.987475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca07b14-7a97-4054-8fe9-c6597671ad67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:35.990063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca07b14-7a97-4054-8fe9-c6597671ad67 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:36.019489 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1166/2318] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:39.500892 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=28 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:40.204229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136572-ce5d-4ffe-b022-734e89ace570 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:40.204511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136572-ce5d-4ffe-b022-734e89ace570 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:40.204790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136572-ce5d-4ffe-b022-734e89ace570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:40.222038 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-e8136572-ce5d-4ffe-b022-734e89ace570 None None] MFA Rules not processed for user `765e8ba07bc1465fa3ce3444d05ad36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:02:40.223301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e8136572-ce5d-4ffe-b022-734e89ace570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:40.231327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1153/2319] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:02:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:02:40.572561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca07b14-7a97-4054-8fe9-c6597671ad67 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:40.582543 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca07b14-7a97-4054-8fe9-c6597671ad67 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:40.586938 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d38b9e-9859-426d-94a1-c89b099f5dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:40.587602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d38b9e-9859-426d-94a1-c89b099f5dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:40.587885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d38b9e-9859-426d-94a1-c89b099f5dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:40.588163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d38b9e-9859-426d-94a1-c89b099f5dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:40.589996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-45d38b9e-9859-426d-94a1-c89b099f5dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:40.601338 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d38b9e-9859-426d-94a1-c89b099f5dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:40.602716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d38b9e-9859-426d-94a1-c89b099f5dd5 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:40.612019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1167/2320] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:40.956454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8136572-ce5d-4ffe-b022-734e89ace570 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:40.958045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e8136572-ce5d-4ffe-b022-734e89ace570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:41.064814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8136572-ce5d-4ffe-b022-734e89ace570 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:41.071227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37f85f-b180-4487-ab7d-d7361a99db9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:41.071894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37f85f-b180-4487-ab7d-d7361a99db9a service placement] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:41.072176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37f85f-b180-4487-ab7d-d7361a99db9a service placement] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:41.072454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37f85f-b180-4487-ab7d-d7361a99db9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:41.074370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9a37f85f-b180-4487-ab7d-d7361a99db9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:41.089123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37f85f-b180-4487-ab7d-d7361a99db9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:41.090974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37f85f-b180-4487-ab7d-d7361a99db9a service placement] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:41.102508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1154/2321] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:46.549018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ff05a-dbc1-43a5-a240-654b1fadeec6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:46.549580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ff05a-dbc1-43a5-a240-654b1fadeec6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:46.549580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ff05a-dbc1-43a5-a240-654b1fadeec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:46.568687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2e2ff05a-dbc1-43a5-a240-654b1fadeec6 None None] MFA Rules not processed for user `7efff0603fb7461ca799c67a8050e181`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:02:46.570566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2e2ff05a-dbc1-43a5-a240-654b1fadeec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:46.578058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1168/2322] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:02:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:02:46.908259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37f85f-b180-4487-ab7d-d7361a99db9a service placement] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:46.918714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37f85f-b180-4487-ab7d-d7361a99db9a service placement] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:46.922762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bede46-f593-49e9-89d1-0f7c2cf0a184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:46.923486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bede46-f593-49e9-89d1-0f7c2cf0a184 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:46.923836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bede46-f593-49e9-89d1-0f7c2cf0a184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:46.924117 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bede46-f593-49e9-89d1-0f7c2cf0a184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:46.926102 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d2bede46-f593-49e9-89d1-0f7c2cf0a184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:46.937132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bede46-f593-49e9-89d1-0f7c2cf0a184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:46.938617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bede46-f593-49e9-89d1-0f7c2cf0a184 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:46.948876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1155/2323] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:54.436082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ff05a-dbc1-43a5-a240-654b1fadeec6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:54.453520 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ff05a-dbc1-43a5-a240-654b1fadeec6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:54.459430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6d3aa-0c41-4dcb-9156-b2edffe39f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:54.460092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6d3aa-0c41-4dcb-9156-b2edffe39f1d service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:54.460374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6d3aa-0c41-4dcb-9156-b2edffe39f1d service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:54.460648 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6d3aa-0c41-4dcb-9156-b2edffe39f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:54.462507 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2dd6d3aa-0c41-4dcb-9156-b2edffe39f1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:54.476689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6d3aa-0c41-4dcb-9156-b2edffe39f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:54.478320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6d3aa-0c41-4dcb-9156-b2edffe39f1d service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:54.489325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1169/2324] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:56.944052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=41 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:04.484940 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=21 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:20.512481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bede46-f593-49e9-89d1-0f7c2cf0a184 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.514045 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d2bede46-f593-49e9-89d1-0f7c2cf0a184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:20.529959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bede46-f593-49e9-89d1-0f7c2cf0a184 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.535037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488c765-1567-4076-b2c7-84e57d5a6c63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.540513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488c765-1567-4076-b2c7-84e57d5a6c63 service placement] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.540513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488c765-1567-4076-b2c7-84e57d5a6c63 service placement] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.540513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488c765-1567-4076-b2c7-84e57d5a6c63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.540513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8488c765-1567-4076-b2c7-84e57d5a6c63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:20.552009 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488c765-1567-4076-b2c7-84e57d5a6c63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.553608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488c765-1567-4076-b2c7-84e57d5a6c63 service placement] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.564037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1156/2325] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:21.702023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcf257-613d-4b06-a869-5c1442ce6d81 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:21.702598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcf257-613d-4b06-a869-5c1442ce6d81 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:21.702598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcf257-613d-4b06-a869-5c1442ce6d81 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:21.703984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1170/2326] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 15:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:03:21.710838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab186847-dad0-405e-aaa0-4fc0fcc806a4 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:21.711393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab186847-dad0-405e-aaa0-4fc0fcc806a4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:21.711572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab186847-dad0-405e-aaa0-4fc0fcc806a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:21.730812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ab186847-dad0-405e-aaa0-4fc0fcc806a4 None None] MFA Rules not processed for user `8940bddd49534f01a8b1bf1dee644216`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:21.732026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ab186847-dad0-405e-aaa0-4fc0fcc806a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:21.739649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1157/2327] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 15:03:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:21.753571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcf257-613d-4b06-a869-5c1442ce6d81 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:21.765787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcf257-613d-4b06-a869-5c1442ce6d81 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:21.769436 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012491a1-f0ce-4020-a177-d7f467ba28e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:21.770272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012491a1-f0ce-4020-a177-d7f467ba28e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:21.770705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012491a1-f0ce-4020-a177-d7f467ba28e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:21.771173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012491a1-f0ce-4020-a177-d7f467ba28e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:21.779467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012491a1-f0ce-4020-a177-d7f467ba28e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:21.780945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012491a1-f0ce-4020-a177-d7f467ba28e5 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:21.789500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1171/2328] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:21.900585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189f3e9-ec7c-402c-97c8-96683569ac67 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:21.900904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189f3e9-ec7c-402c-97c8-96683569ac67 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:21.901185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189f3e9-ec7c-402c-97c8-96683569ac67 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:21.902688 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1158/2329] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 15:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:03:21.908206 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1a16-928f-494e-8a01-4bf269bf741e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:21.908569 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1a16-928f-494e-8a01-4bf269bf741e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:21.908843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1a16-928f-494e-8a01-4bf269bf741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:21.928044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a9ae1a16-928f-494e-8a01-4bf269bf741e None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:21.929257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a9ae1a16-928f-494e-8a01-4bf269bf741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:21.938702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1172/2330] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 15:03:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:21.949953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189f3e9-ec7c-402c-97c8-96683569ac67 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:21.961342 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189f3e9-ec7c-402c-97c8-96683569ac67 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:21.965010 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f90c0-6623-4aa3-94dd-2ef430b058f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:21.965689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f90c0-6623-4aa3-94dd-2ef430b058f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:21.966006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f90c0-6623-4aa3-94dd-2ef430b058f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:21.966287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f90c0-6623-4aa3-94dd-2ef430b058f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:21.979546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f90c0-6623-4aa3-94dd-2ef430b058f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:21.979546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f90c0-6623-4aa3-94dd-2ef430b058f2 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:21.991146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1159/2331] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:26.196435 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1a16-928f-494e-8a01-4bf269bf741e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:26.205870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1a16-928f-494e-8a01-4bf269bf741e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:26.210145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c8572-cf6f-4b47-8003-c8c024258553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:26.210799 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8572-cf6f-4b47-8003-c8c024258553 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:26.211084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8572-cf6f-4b47-8003-c8c024258553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:26.211363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8572-cf6f-4b47-8003-c8c024258553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:26.213168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d14c8572-cf6f-4b47-8003-c8c024258553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:26.276798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c8572-cf6f-4b47-8003-c8c024258553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:26.278383 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c8572-cf6f-4b47-8003-c8c024258553 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:26.288469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1173/2332] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:29.422384 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f90c0-6623-4aa3-94dd-2ef430b058f2 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:29.435546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f90c0-6623-4aa3-94dd-2ef430b058f2 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:29.440884 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff9e92-a4b4-4ae3-aa3d-f7309ae69484 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:29.444733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9e92-a4b4-4ae3-aa3d-f7309ae69484 service placement] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:29.444733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9e92-a4b4-4ae3-aa3d-f7309ae69484 service placement] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:29.444733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9e92-a4b4-4ae3-aa3d-f7309ae69484 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:29.447250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c6ff9e92-a4b4-4ae3-aa3d-f7309ae69484 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:29.461550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff9e92-a4b4-4ae3-aa3d-f7309ae69484 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:29.463850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff9e92-a4b4-4ae3-aa3d-f7309ae69484 service placement] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:29.480694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1160/2333] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:29.484013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c8572-cf6f-4b47-8003-c8c024258553 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:29.485621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d14c8572-cf6f-4b47-8003-c8c024258553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:29.501413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c8572-cf6f-4b47-8003-c8c024258553 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:29.506882 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce306d63-e224-470b-9995-3591ebd8f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:29.507781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce306d63-e224-470b-9995-3591ebd8f02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:29.508067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce306d63-e224-470b-9995-3591ebd8f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:29.508515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce306d63-e224-470b-9995-3591ebd8f02a admin admin] PATH_INFO: `/v3/users/555dc188a72647f3af56b774d04ab4b0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:29.509950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce306d63-e224-470b-9995-3591ebd8f02a admin admin] RBAC: Authorizing `identity:delete_user(user_id=555dc188a72647f3af56b774d04ab4b0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:29.511880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce306d63-e224-470b-9995-3591ebd8f02a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:29.564291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ce306d63-e224-470b-9995-3591ebd8f02a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555dc188a72647f3af56b774d04ab4b0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.564941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ce306d63-e224-470b-9995-3591ebd8f02a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555dc188a72647f3af56b774d04ab4b0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.565546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ce306d63-e224-470b-9995-3591ebd8f02a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555dc188a72647f3af56b774d04ab4b0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.572806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ce306d63-e224-470b-9995-3591ebd8f02a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555dc188a72647f3af56b774d04ab4b0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.579854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ce306d63-e224-470b-9995-3591ebd8f02a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555dc188a72647f3af56b774d04ab4b0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.599021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1174/2334] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:29 2022] DELETE /identity/v3/users/555dc188a72647f3af56b774d04ab4b0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:29.781299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff9e92-a4b4-4ae3-aa3d-f7309ae69484 service placement] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:29.792646 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff9e92-a4b4-4ae3-aa3d-f7309ae69484 service placement] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:29.856282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:29.857420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:29.857837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:29.858295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] PATH_INFO: `/v3/projects/0eec2973f1b24982bf56c38e77d91481` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:29.859851 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eec2973f1b24982bf56c38e77d91481)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:29.862141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:29.910453 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eec2973f1b24982bf56c38e77d91481', 'request_id': 'req-3c8b933b-fb47-44c0-858c-b00f69bd0a66'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.918765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eec2973f1b24982bf56c38e77d91481', 'request_id': 'req-3c8b933b-fb47-44c0-858c-b00f69bd0a66'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.925253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eec2973f1b24982bf56c38e77d91481', 'request_id': 'req-3c8b933b-fb47-44c0-858c-b00f69bd0a66'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.936372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] The token cache is being invalidate because project 0eec2973f1b24982bf56c38e77d91481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:29.936662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.937305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3c8b933b-fb47-44c0-858c-b00f69bd0a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.938878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1161/2335] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:29 2022] DELETE /identity/v3/projects/0eec2973f1b24982bf56c38e77d91481 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:29.944117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991689cd-5286-4c3c-a711-aa83c34a411c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:29.944397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991689cd-5286-4c3c-a711-aa83c34a411c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:29.944676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991689cd-5286-4c3c-a711-aa83c34a411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:29.964058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-991689cd-5286-4c3c-a711-aa83c34a411c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:29.965255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-991689cd-5286-4c3c-a711-aa83c34a411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:30.011531 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:30.032193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1175/2336] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:03:30.040562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd1b3a-e6dc-4184-9410-2732c0a80bb3 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.040851 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd1b3a-e6dc-4184-9410-2732c0a80bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.041131 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd1b3a-e6dc-4184-9410-2732c0a80bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.059682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-32fd1b3a-e6dc-4184-9410-2732c0a80bb3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:30.060877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-32fd1b3a-e6dc-4184-9410-2732c0a80bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:30.068900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1162/2337] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:30.073454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991689cd-5286-4c3c-a711-aa83c34a411c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.084361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991689cd-5286-4c3c-a711-aa83c34a411c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.089811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09159a-69a8-4857-8a6e-9a85fe8f8aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.090511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09159a-69a8-4857-8a6e-9a85fe8f8aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.090793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09159a-69a8-4857-8a6e-9a85fe8f8aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.091067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09159a-69a8-4857-8a6e-9a85fe8f8aa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.091792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09159a-69a8-4857-8a6e-9a85fe8f8aa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:30.092102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09159a-69a8-4857-8a6e-9a85fe8f8aa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.093693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09159a-69a8-4857-8a6e-9a85fe8f8aa7 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.111765 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1176/2338] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:30.112935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd1b3a-e6dc-4184-9410-2732c0a80bb3 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.123104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd1b3a-e6dc-4184-9410-2732c0a80bb3 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.127830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a836594-0cb3-45ad-9846-13fb022ccab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.128618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836594-0cb3-45ad-9846-13fb022ccab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.128970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836594-0cb3-45ad-9846-13fb022ccab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.129254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836594-0cb3-45ad-9846-13fb022ccab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.130187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a836594-0cb3-45ad-9846-13fb022ccab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.132395 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a836594-0cb3-45ad-9846-13fb022ccab8 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.170682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1163/2339] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:30.174534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09159a-69a8-4857-8a6e-9a85fe8f8aa7 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.185725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09159a-69a8-4857-8a6e-9a85fe8f8aa7 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.256933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce8ba7-2af7-4b24-b074-671f7cb3ca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.257613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce8ba7-2af7-4b24-b074-671f7cb3ca69 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.257907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce8ba7-2af7-4b24-b074-671f7cb3ca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.258235 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce8ba7-2af7-4b24-b074-671f7cb3ca69 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.258945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce8ba7-2af7-4b24-b074-671f7cb3ca69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.261117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce8ba7-2af7-4b24-b074-671f7cb3ca69 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.285453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1177/2340] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:30.287092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a836594-0cb3-45ad-9846-13fb022ccab8 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.297600 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a836594-0cb3-45ad-9846-13fb022ccab8 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.303517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5786b7-f9c8-4650-84c1-f26dccd3701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.304185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5786b7-f9c8-4650-84c1-f26dccd3701c admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.304466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5786b7-f9c8-4650-84c1-f26dccd3701c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.304742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5786b7-f9c8-4650-84c1-f26dccd3701c admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.305592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5786b7-f9c8-4650-84c1-f26dccd3701c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.307313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5786b7-f9c8-4650-84c1-f26dccd3701c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.308669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:30.319627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1164/2341] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:30.323092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce8ba7-2af7-4b24-b074-671f7cb3ca69 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.333970 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce8ba7-2af7-4b24-b074-671f7cb3ca69 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.340757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65736c64-11e6-4b57-a7bd-31399ae13648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.341599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736c64-11e6-4b57-a7bd-31399ae13648 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.341904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736c64-11e6-4b57-a7bd-31399ae13648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.342220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736c64-11e6-4b57-a7bd-31399ae13648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.343056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65736c64-11e6-4b57-a7bd-31399ae13648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.345224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65736c64-11e6-4b57-a7bd-31399ae13648 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.360211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1178/2342] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:03:30.368094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5786b7-f9c8-4650-84c1-f26dccd3701c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.378441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5786b7-f9c8-4650-84c1-f26dccd3701c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.383081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede96927-2367-46ab-ba75-54d047532a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.383987 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede96927-2367-46ab-ba75-54d047532a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.384267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede96927-2367-46ab-ba75-54d047532a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.384797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede96927-2367-46ab-ba75-54d047532a7e admin admin] PATH_INFO: `/v3/projects/89c8df9235c547e5a01590f87f04d412/users/c9720ba46ac745678d708c71a937a07b/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.400926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede96927-2367-46ab-ba75-54d047532a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c8df9235c547e5a01590f87f04d412, user_id=c9720ba46ac745678d708c71a937a07b, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.403832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede96927-2367-46ab-ba75-54d047532a7e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.420343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1165/2343] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:30 2022] PUT /identity/v3/projects/89c8df9235c547e5a01590f87f04d412/users/c9720ba46ac745678d708c71a937a07b/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:03:30.431497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd04b-ac2c-40a3-a766-1504878abf60 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.431761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd04b-ac2c-40a3-a766-1504878abf60 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.432034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd04b-ac2c-40a3-a766-1504878abf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.459058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f05dd04b-ac2c-40a3-a766-1504878abf60 None None] MFA Rules not processed for user `c9720ba46ac745678d708c71a937a07b`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:30.460437 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f05dd04b-ac2c-40a3-a766-1504878abf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:30.533295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1179/2344] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:30.544726 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede96927-2367-46ab-ba75-54d047532a7e admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.546555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ede96927-2367-46ab-ba75-54d047532a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:30.626840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede96927-2367-46ab-ba75-54d047532a7e admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.633931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b7b1b-7769-454c-ae6a-62284c219fec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.634984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b7b1b-7769-454c-ae6a-62284c219fec service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.635274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b7b1b-7769-454c-ae6a-62284c219fec service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.635553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b7b1b-7769-454c-ae6a-62284c219fec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.644215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b7b1b-7769-454c-ae6a-62284c219fec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.646016 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b7b1b-7769-454c-ae6a-62284c219fec service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.657228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1166/2345] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:34.415752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dd04b-ac2c-40a3-a766-1504878abf60 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.465817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:34.492046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dd04b-ac2c-40a3-a766-1504878abf60 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.496744 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.497767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.498083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.498427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] PATH_INFO: `/v3/users/c9720ba46ac745678d708c71a937a07b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.500482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9720ba46ac745678d708c71a937a07b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.502482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.559722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9720ba46ac745678d708c71a937a07b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:34.559983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9720ba46ac745678d708c71a937a07b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:34.560603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9720ba46ac745678d708c71a937a07b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:34.569572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9720ba46ac745678d708c71a937a07b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:34.579104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9720ba46ac745678d708c71a937a07b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:34.599033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1180/2346] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:34 2022] DELETE /identity/v3/users/c9720ba46ac745678d708c71a937a07b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:34.603862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48671398-ec06-4135-ad23-55d01361f9ee None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.604396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48671398-ec06-4135-ad23-55d01361f9ee None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.604596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48671398-ec06-4135-ad23-55d01361f9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.623283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-48671398-ec06-4135-ad23-55d01361f9ee None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:34.624500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-48671398-ec06-4135-ad23-55d01361f9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:34.694670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1167/2347] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:34.704759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.706261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:34.772834 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d210876-f6e4-4d9a-a386-b118ece04f35 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.778244 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca417e-a8d1-4766-8c3c-9d855371decc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.778782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca417e-a8d1-4766-8c3c-9d855371decc service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.779106 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca417e-a8d1-4766-8c3c-9d855371decc service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.779416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca417e-a8d1-4766-8c3c-9d855371decc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.790496 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca417e-a8d1-4766-8c3c-9d855371decc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.792057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca417e-a8d1-4766-8c3c-9d855371decc service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.802310 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1181/2348] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:35.122714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48671398-ec06-4135-ad23-55d01361f9ee None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.124212 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-48671398-ec06-4135-ad23-55d01361f9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:35.139323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48671398-ec06-4135-ad23-55d01361f9ee None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.144099 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.145299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.145586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.146552 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] PATH_INFO: `/v3/projects/89c8df9235c547e5a01590f87f04d412` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.148500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c8df9235c547e5a01590f87f04d412)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.149951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.204802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c8df9235c547e5a01590f87f04d412', 'request_id': 'req-28df8c38-3b57-4b25-8724-d061f163091b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:35.208564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:35.215611 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c8df9235c547e5a01590f87f04d412', 'request_id': 'req-28df8c38-3b57-4b25-8724-d061f163091b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:35.224427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c8df9235c547e5a01590f87f04d412', 'request_id': 'req-28df8c38-3b57-4b25-8724-d061f163091b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:35.235187 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] The token cache is being invalidate because project 89c8df9235c547e5a01590f87f04d412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:35.235523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:35.236229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-28df8c38-3b57-4b25-8724-d061f163091b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:35.239426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1168/2349] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:35 2022] DELETE /identity/v3/projects/89c8df9235c547e5a01590f87f04d412 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:35.244258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d41d-645c-46cb-9490-7f1c79bc22e5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.244547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d41d-645c-46cb-9490-7f1c79bc22e5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.244826 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d41d-645c-46cb-9490-7f1c79bc22e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.263487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8016d41d-645c-46cb-9490-7f1c79bc22e5 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:35.264760 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8016d41d-645c-46cb-9490-7f1c79bc22e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:35.330618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1182/2350] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:35.340432 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8928-98aa-471f-a984-4c636c3b7b1d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.340727 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8928-98aa-471f-a984-4c636c3b7b1d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.341013 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8928-98aa-471f-a984-4c636c3b7b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.361177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3fec8928-98aa-471f-a984-4c636c3b7b1d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:35.362473 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3fec8928-98aa-471f-a984-4c636c3b7b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:35.372214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1169/2351] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:03:35.376725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d41d-645c-46cb-9490-7f1c79bc22e5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.383242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:35.389112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d41d-645c-46cb-9490-7f1c79bc22e5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.398732 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed42786-bf4b-45e4-82ab-9e041af95de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.399671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed42786-bf4b-45e4-82ab-9e041af95de0 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.400227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed42786-bf4b-45e4-82ab-9e041af95de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.401279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed42786-bf4b-45e4-82ab-9e041af95de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.402184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed42786-bf4b-45e4-82ab-9e041af95de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:35.402723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed42786-bf4b-45e4-82ab-9e041af95de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.405087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed42786-bf4b-45e4-82ab-9e041af95de0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.418850 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1183/2352] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:35.424181 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec8928-98aa-471f-a984-4c636c3b7b1d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.437158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec8928-98aa-471f-a984-4c636c3b7b1d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.442514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c7425-5824-4ac9-a9db-6e5957fe51cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.443217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c7425-5824-4ac9-a9db-6e5957fe51cc admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.443500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c7425-5824-4ac9-a9db-6e5957fe51cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.443775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c7425-5824-4ac9-a9db-6e5957fe51cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.444466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c7425-5824-4ac9-a9db-6e5957fe51cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.446461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c7425-5824-4ac9-a9db-6e5957fe51cc admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.479172 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1170/2353] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:35 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:35.483547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed42786-bf4b-45e4-82ab-9e041af95de0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.496714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed42786-bf4b-45e4-82ab-9e041af95de0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.558488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c8ffe-bd8f-470e-a5f7-2bb96039ed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.559229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c8ffe-bd8f-470e-a5f7-2bb96039ed3d admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.559514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c8ffe-bd8f-470e-a5f7-2bb96039ed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.559794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c8ffe-bd8f-470e-a5f7-2bb96039ed3d admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.560504 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c8ffe-bd8f-470e-a5f7-2bb96039ed3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.562580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c8ffe-bd8f-470e-a5f7-2bb96039ed3d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.591479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1184/2354] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:35 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:35.592685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c7425-5824-4ac9-a9db-6e5957fe51cc admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.607167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c7425-5824-4ac9-a9db-6e5957fe51cc admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.612171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58369b-66d5-44e2-81ff-9e6d841c8474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.613031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58369b-66d5-44e2-81ff-9e6d841c8474 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.613298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58369b-66d5-44e2-81ff-9e6d841c8474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.613568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58369b-66d5-44e2-81ff-9e6d841c8474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.614321 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58369b-66d5-44e2-81ff-9e6d841c8474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.616043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58369b-66d5-44e2-81ff-9e6d841c8474 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.627347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1171/2355] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:35.639419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c8ffe-bd8f-470e-a5f7-2bb96039ed3d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.655405 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c8ffe-bd8f-470e-a5f7-2bb96039ed3d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.664937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ae445-9c91-41df-972e-c43f19407362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.665637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae445-9c91-41df-972e-c43f19407362 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.665953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae445-9c91-41df-972e-c43f19407362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.666451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae445-9c91-41df-972e-c43f19407362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.667722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ae445-9c91-41df-972e-c43f19407362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.673585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ae445-9c91-41df-972e-c43f19407362 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.682311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1185/2356] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:35.687541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58369b-66d5-44e2-81ff-9e6d841c8474 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.701650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58369b-66d5-44e2-81ff-9e6d841c8474 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.708437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f995d-83f3-4985-ab3f-c2e8ad12abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.709378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f995d-83f3-4985-ab3f-c2e8ad12abcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.709780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f995d-83f3-4985-ab3f-c2e8ad12abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.710039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f995d-83f3-4985-ab3f-c2e8ad12abcb admin admin] PATH_INFO: `/v3/projects/d25bd24f3911412cb97f95f8f919bf39/users/165ba93c0a1346a0b47e2f791fc029f2/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.730915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f995d-83f3-4985-ab3f-c2e8ad12abcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25bd24f3911412cb97f95f8f919bf39, user_id=165ba93c0a1346a0b47e2f791fc029f2, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.733639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f995d-83f3-4985-ab3f-c2e8ad12abcb admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.750353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1172/2357] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:35 2022] PUT /identity/v3/projects/d25bd24f3911412cb97f95f8f919bf39/users/165ba93c0a1346a0b47e2f791fc029f2/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:03:35.764235 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5cfc6-0fbc-4daa-9ec4-ed376a38bfaf None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.766008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5cfc6-0fbc-4daa-9ec4-ed376a38bfaf None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.766008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5cfc6-0fbc-4daa-9ec4-ed376a38bfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.800785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-63b5cfc6-0fbc-4daa-9ec4-ed376a38bfaf None None] MFA Rules not processed for user `165ba93c0a1346a0b47e2f791fc029f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:35.802199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-63b5cfc6-0fbc-4daa-9ec4-ed376a38bfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:35.903794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1186/2358] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:35.918737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f995d-83f3-4985-ab3f-c2e8ad12abcb admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.921244 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-289f995d-83f3-4985-ab3f-c2e8ad12abcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:35.989999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f995d-83f3-4985-ab3f-c2e8ad12abcb admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.995836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46768f47-7fa4-4eab-93a9-13033b35600e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.996549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46768f47-7fa4-4eab-93a9-13033b35600e service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.996827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46768f47-7fa4-4eab-93a9-13033b35600e service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.997101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46768f47-7fa4-4eab-93a9-13033b35600e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:36.009679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46768f47-7fa4-4eab-93a9-13033b35600e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:36.011183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46768f47-7fa4-4eab-93a9-13033b35600e service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:36.026551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1173/2359] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:43.670628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0149f-d403-442b-b592-7b9e080a563e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.671123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0149f-d403-442b-b592-7b9e080a563e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.671372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0149f-d403-442b-b592-7b9e080a563e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.689987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-32d0149f-d403-442b-b592-7b9e080a563e None None] MFA Rules not processed for user `561c947ee70e4521b594f0d528e6e6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:43.692225 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-32d0149f-d403-442b-b592-7b9e080a563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:43.752433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1187/2360] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:45.575728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46768f47-7fa4-4eab-93a9-13033b35600e service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.661725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46768f47-7fa4-4eab-93a9-13033b35600e service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.671097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.671621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.672009 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.672442 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] PATH_INFO: `/v3/users/165ba93c0a1346a0b47e2f791fc029f2` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.673737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=165ba93c0a1346a0b47e2f791fc029f2)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.677449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.702811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:45.734737 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165ba93c0a1346a0b47e2f791fc029f2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.742240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165ba93c0a1346a0b47e2f791fc029f2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.754481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165ba93c0a1346a0b47e2f791fc029f2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.755208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165ba93c0a1346a0b47e2f791fc029f2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.763993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165ba93c0a1346a0b47e2f791fc029f2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.771943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1174/2361] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:45 2022] DELETE /identity/v3/users/165ba93c0a1346a0b47e2f791fc029f2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:03:45.778362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06889a1-f271-4b6f-872f-294949695a33 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.778788 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06889a1-f271-4b6f-872f-294949695a33 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.779380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06889a1-f271-4b6f-872f-294949695a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.788799 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:45.802641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f06889a1-f271-4b6f-872f-294949695a33 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:45.803841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f06889a1-f271-4b6f-872f-294949695a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:45.864215 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1188/2362] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:45.873997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.875438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:45.938029 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba56088-6406-4f56-8b96-cf28526a9600 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.941901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ea11c-40ff-4936-b048-2d0ddd54053d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.942571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea11c-40ff-4936-b048-2d0ddd54053d service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.942880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea11c-40ff-4936-b048-2d0ddd54053d service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.943208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea11c-40ff-4936-b048-2d0ddd54053d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.952992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ea11c-40ff-4936-b048-2d0ddd54053d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.954420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ea11c-40ff-4936-b048-2d0ddd54053d service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.965949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1175/2363] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:46.452361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06889a1-f271-4b6f-872f-294949695a33 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:46.454249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f06889a1-f271-4b6f-872f-294949695a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:46.468466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06889a1-f271-4b6f-872f-294949695a33 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:46.480290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:46.481355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.481656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.482102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] PATH_INFO: `/v3/projects/d25bd24f3911412cb97f95f8f919bf39` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.483684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25bd24f3911412cb97f95f8f919bf39)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:46.486443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:46.543125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25bd24f3911412cb97f95f8f919bf39', 'request_id': 'req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:46.555358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25bd24f3911412cb97f95f8f919bf39', 'request_id': 'req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:46.562990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25bd24f3911412cb97f95f8f919bf39', 'request_id': 'req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:46.576210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] The token cache is being invalidate because project d25bd24f3911412cb97f95f8f919bf39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:46.576503 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:46.577203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c27e7db9-9ce7-4a24-b7bc-cf08edd92200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:46.579657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1189/2364] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:46 2022] DELETE /identity/v3/projects/d25bd24f3911412cb97f95f8f919bf39 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:46.585286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36934f-6211-4bdd-8486-c16f5b76c595 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.585821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36934f-6211-4bdd-8486-c16f5b76c595 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.585821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36934f-6211-4bdd-8486-c16f5b76c595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.605579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-9b36934f-6211-4bdd-8486-c16f5b76c595 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:46.606849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-9b36934f-6211-4bdd-8486-c16f5b76c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:46.683265 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1176/2365] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:46.691427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475884ea-0997-4935-b2f2-9443129b0f4c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.691785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475884ea-0997-4935-b2f2-9443129b0f4c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.692603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475884ea-0997-4935-b2f2-9443129b0f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.723112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-475884ea-0997-4935-b2f2-9443129b0f4c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:46.724296 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-475884ea-0997-4935-b2f2-9443129b0f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:46.733937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1190/2366] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:46.739267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36934f-6211-4bdd-8486-c16f5b76c595 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:46.750974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36934f-6211-4bdd-8486-c16f5b76c595 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:46.757525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a168fe3-4e16-43c3-9e62-9b170e1b7124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:46.758587 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168fe3-4e16-43c3-9e62-9b170e1b7124 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.759110 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168fe3-4e16-43c3-9e62-9b170e1b7124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.759710 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168fe3-4e16-43c3-9e62-9b170e1b7124 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.760542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a168fe3-4e16-43c3-9e62-9b170e1b7124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:46.760922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a168fe3-4e16-43c3-9e62-9b170e1b7124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:46.762780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a168fe3-4e16-43c3-9e62-9b170e1b7124 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:46.778670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1177/2367] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:46.783323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475884ea-0997-4935-b2f2-9443129b0f4c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:46.797115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475884ea-0997-4935-b2f2-9443129b0f4c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:46.804422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1c4ea-2c52-4363-8dc1-2b05f656afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:46.805222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1c4ea-2c52-4363-8dc1-2b05f656afd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.805574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1c4ea-2c52-4363-8dc1-2b05f656afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.805955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1c4ea-2c52-4363-8dc1-2b05f656afd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.807125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1c4ea-2c52-4363-8dc1-2b05f656afd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:46.809133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1c4ea-2c52-4363-8dc1-2b05f656afd4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:46.846493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1191/2368] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:46 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:46.851164 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a168fe3-4e16-43c3-9e62-9b170e1b7124 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:46.863028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a168fe3-4e16-43c3-9e62-9b170e1b7124 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:46.895935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:46.933344 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5114ca-70f2-48fe-a19a-f02116a5650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:46.934068 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5114ca-70f2-48fe-a19a-f02116a5650f admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.934355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5114ca-70f2-48fe-a19a-f02116a5650f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.934631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5114ca-70f2-48fe-a19a-f02116a5650f admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.935328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5114ca-70f2-48fe-a19a-f02116a5650f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:46.937343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5114ca-70f2-48fe-a19a-f02116a5650f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:46.959759 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1178/2369] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:46 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:46.964371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1c4ea-2c52-4363-8dc1-2b05f656afd4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:46.976501 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1c4ea-2c52-4363-8dc1-2b05f656afd4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:46.981618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f13f06-d533-4f9b-8802-7b77253ee26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:46.982344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f13f06-d533-4f9b-8802-7b77253ee26a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.982627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f13f06-d533-4f9b-8802-7b77253ee26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.982891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f13f06-d533-4f9b-8802-7b77253ee26a admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.983703 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f13f06-d533-4f9b-8802-7b77253ee26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:46.985351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f13f06-d533-4f9b-8802-7b77253ee26a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:46.998838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1192/2370] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:47.003002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5114ca-70f2-48fe-a19a-f02116a5650f admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:47.015542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5114ca-70f2-48fe-a19a-f02116a5650f admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:47.022261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111eea8-1a40-453a-8d8f-d4fafce19674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:47.023331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111eea8-1a40-453a-8d8f-d4fafce19674 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.023819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111eea8-1a40-453a-8d8f-d4fafce19674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.024433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111eea8-1a40-453a-8d8f-d4fafce19674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.025381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111eea8-1a40-453a-8d8f-d4fafce19674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:47.027590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111eea8-1a40-453a-8d8f-d4fafce19674 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:47.048482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1179/2371] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:47.049603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f13f06-d533-4f9b-8802-7b77253ee26a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:47.060970 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f13f06-d533-4f9b-8802-7b77253ee26a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:47.065786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951392-cc00-4caa-8b4f-081e1f2a4b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:47.066698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951392-cc00-4caa-8b4f-081e1f2a4b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.066980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951392-cc00-4caa-8b4f-081e1f2a4b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.067256 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951392-cc00-4caa-8b4f-081e1f2a4b52 admin admin] PATH_INFO: `/v3/projects/4969b0748cae4180ac89d9149342db17/users/030bf73ccb4c425590569355eb625ae1/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.084733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951392-cc00-4caa-8b4f-081e1f2a4b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4969b0748cae4180ac89d9149342db17, user_id=030bf73ccb4c425590569355eb625ae1, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:47.087641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951392-cc00-4caa-8b4f-081e1f2a4b52 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:47.105029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1193/2372] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:47 2022] PUT /identity/v3/projects/4969b0748cae4180ac89d9149342db17/users/030bf73ccb4c425590569355eb625ae1/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:03:47.118393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb0be-c7e0-4bc2-9e99-83fb9349394b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.118664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb0be-c7e0-4bc2-9e99-83fb9349394b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.118947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb0be-c7e0-4bc2-9e99-83fb9349394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.149451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-00dfb0be-c7e0-4bc2-9e99-83fb9349394b None None] MFA Rules not processed for user `030bf73ccb4c425590569355eb625ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:47.150725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-00dfb0be-c7e0-4bc2-9e99-83fb9349394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:47.228631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1180/2373] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:47.233307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951392-cc00-4caa-8b4f-081e1f2a4b52 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:47.262961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:47.303534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951392-cc00-4caa-8b4f-081e1f2a4b52 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:47.308487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fc622-5966-4984-b9b1-ccdc97c08bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:47.309140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fc622-5966-4984-b9b1-ccdc97c08bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.309629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fc622-5966-4984-b9b1-ccdc97c08bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.309743 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fc622-5966-4984-b9b1-ccdc97c08bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.310422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fc622-5966-4984-b9b1-ccdc97c08bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:47.313427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fc622-5966-4984-b9b1-ccdc97c08bf8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:47.346772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1194/2374] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:47 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:47.349384 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfb0be-c7e0-4bc2-9e99-83fb9349394b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:47.361707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfb0be-c7e0-4bc2-9e99-83fb9349394b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:47.440917 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65196639-98b6-4662-9ef8-a9280a236c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:47.441740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65196639-98b6-4662-9ef8-a9280a236c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.442164 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65196639-98b6-4662-9ef8-a9280a236c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.442681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65196639-98b6-4662-9ef8-a9280a236c32 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.443661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65196639-98b6-4662-9ef8-a9280a236c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:47.447825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65196639-98b6-4662-9ef8-a9280a236c32 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:47.473741 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1181/2375] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:47 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:47.478052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fc622-5966-4984-b9b1-ccdc97c08bf8 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:47.489521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fc622-5966-4984-b9b1-ccdc97c08bf8 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:47.495051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b4fdd-5862-49d9-9a06-80cb009a7625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:47.495774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b4fdd-5862-49d9-9a06-80cb009a7625 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.496047 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b4fdd-5862-49d9-9a06-80cb009a7625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.496324 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b4fdd-5862-49d9-9a06-80cb009a7625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.497075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b4fdd-5862-49d9-9a06-80cb009a7625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:47.498770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b4fdd-5862-49d9-9a06-80cb009a7625 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:47.515594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1195/2376] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:47.517076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65196639-98b6-4662-9ef8-a9280a236c32 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:47.531793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65196639-98b6-4662-9ef8-a9280a236c32 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:47.538653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a3be0-79d4-439b-bf37-5c481cfd5b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:47.539575 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a3be0-79d4-439b-bf37-5c481cfd5b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.539898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a3be0-79d4-439b-bf37-5c481cfd5b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.540119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a3be0-79d4-439b-bf37-5c481cfd5b4b admin admin] PATH_INFO: `/v3/projects/48cc0b24f0014eb2b4eaf14d8aa53775/users/f6dee47f341b459aae033f1cdc760fb7/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.569155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a3be0-79d4-439b-bf37-5c481cfd5b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cc0b24f0014eb2b4eaf14d8aa53775, user_id=f6dee47f341b459aae033f1cdc760fb7, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:47.573508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a3be0-79d4-439b-bf37-5c481cfd5b4b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:47.595196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1182/2377] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:47 2022] PUT /identity/v3/projects/48cc0b24f0014eb2b4eaf14d8aa53775/users/f6dee47f341b459aae033f1cdc760fb7/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:47.600766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b4fdd-5862-49d9-9a06-80cb009a7625 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:47.614376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b4fdd-5862-49d9-9a06-80cb009a7625 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:47.755429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0a977-ee22-4c5f-ad7e-daa3dd083970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:47.756304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0a977-ee22-4c5f-ad7e-daa3dd083970 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.756747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0a977-ee22-4c5f-ad7e-daa3dd083970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.757034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0a977-ee22-4c5f-ad7e-daa3dd083970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.757835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0a977-ee22-4c5f-ad7e-daa3dd083970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:47.759813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0a977-ee22-4c5f-ad7e-daa3dd083970 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:47.774681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1196/2378] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:47.779617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a3be0-79d4-439b-bf37-5c481cfd5b4b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:47.787186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:47.796751 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a3be0-79d4-439b-bf37-5c481cfd5b4b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:47.804444 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a89ffd-69e1-4cf3-93a2-dbab8fec9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:47.805451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a89ffd-69e1-4cf3-93a2-dbab8fec9b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.805834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a89ffd-69e1-4cf3-93a2-dbab8fec9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.806337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a89ffd-69e1-4cf3-93a2-dbab8fec9b46 admin admin] PATH_INFO: `/v3/projects/48cc0b24f0014eb2b4eaf14d8aa53775/users/f6dee47f341b459aae033f1cdc760fb7/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.808467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a89ffd-69e1-4cf3-93a2-dbab8fec9b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cc0b24f0014eb2b4eaf14d8aa53775, user_id=f6dee47f341b459aae033f1cdc760fb7, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:47.811459 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a89ffd-69e1-4cf3-93a2-dbab8fec9b46 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:47.825010 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1183/2379] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:47 2022] PUT /identity/v3/projects/48cc0b24f0014eb2b4eaf14d8aa53775/users/f6dee47f341b459aae033f1cdc760fb7/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:47.839112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f27c49-699d-4447-beb4-120fe6179e05 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.839719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f27c49-699d-4447-beb4-120fe6179e05 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.839719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f27c49-699d-4447-beb4-120fe6179e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.890538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-27f27c49-699d-4447-beb4-120fe6179e05 None None] MFA Rules not processed for user `f6dee47f341b459aae033f1cdc760fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:47.892291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-27f27c49-699d-4447-beb4-120fe6179e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:47.986359 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1197/2380] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:47.998876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a89ffd-69e1-4cf3-93a2-dbab8fec9b46 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:48.001056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-61a89ffd-69e1-4cf3-93a2-dbab8fec9b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:48.073235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a89ffd-69e1-4cf3-93a2-dbab8fec9b46 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:48.077287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7c01e-e428-42ea-a748-d1dd6bf3debd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:48.077938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7c01e-e428-42ea-a748-d1dd6bf3debd service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:48.078224 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7c01e-e428-42ea-a748-d1dd6bf3debd service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:48.078500 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7c01e-e428-42ea-a748-d1dd6bf3debd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:48.089462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7c01e-e428-42ea-a748-d1dd6bf3debd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:48.091328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7c01e-e428-42ea-a748-d1dd6bf3debd service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:48.103966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1184/2381] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:48.548448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f27c49-699d-4447-beb4-120fe6179e05 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:48.571366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:48.624425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f27c49-699d-4447-beb4-120fe6179e05 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:48.629658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:48.630702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:48.630984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:48.631255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] PATH_INFO: `/v3/users/030bf73ccb4c425590569355eb625ae1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:48.632488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=030bf73ccb4c425590569355eb625ae1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:48.634770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:48.690018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030bf73ccb4c425590569355eb625ae1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:48.690786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030bf73ccb4c425590569355eb625ae1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:48.691412 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030bf73ccb4c425590569355eb625ae1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:48.698786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030bf73ccb4c425590569355eb625ae1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:48.707584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030bf73ccb4c425590569355eb625ae1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:48.728360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1198/2382] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:48 2022] DELETE /identity/v3/users/030bf73ccb4c425590569355eb625ae1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:48.733028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1e14-b207-4e27-9d03-75c0ee2f30a4 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:48.733559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1e14-b207-4e27-9d03-75c0ee2f30a4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:48.733559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1e14-b207-4e27-9d03-75c0ee2f30a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:48.752211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3b7a1e14-b207-4e27-9d03-75c0ee2f30a4 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:48.753731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3b7a1e14-b207-4e27-9d03-75c0ee2f30a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:48.817538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1185/2383] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:48.827638 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:48.829187 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:48.893326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ff792-ad53-45f5-9780-d96c7933d7cb admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:48.897994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43313a-3c7a-4b9d-b333-eeaadd0c8b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:48.898703 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43313a-3c7a-4b9d-b333-eeaadd0c8b91 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:48.899092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43313a-3c7a-4b9d-b333-eeaadd0c8b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:48.899497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43313a-3c7a-4b9d-b333-eeaadd0c8b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:48.910458 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43313a-3c7a-4b9d-b333-eeaadd0c8b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:48.911909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43313a-3c7a-4b9d-b333-eeaadd0c8b91 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:48.922845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1199/2384] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:49.290997 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a1e14-b207-4e27-9d03-75c0ee2f30a4 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:49.293112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3b7a1e14-b207-4e27-9d03-75c0ee2f30a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:49.305972 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a1e14-b207-4e27-9d03-75c0ee2f30a4 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:49.310818 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:49.311718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:49.312003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:49.312283 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] PATH_INFO: `/v3/projects/4969b0748cae4180ac89d9149342db17` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:49.313582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4969b0748cae4180ac89d9149342db17)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:49.316286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:49.374208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4969b0748cae4180ac89d9149342db17', 'request_id': 'req-c4e8f0b0-822e-4f79-8adb-604b8971157d'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.384565 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4969b0748cae4180ac89d9149342db17', 'request_id': 'req-c4e8f0b0-822e-4f79-8adb-604b8971157d'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.391763 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4969b0748cae4180ac89d9149342db17', 'request_id': 'req-c4e8f0b0-822e-4f79-8adb-604b8971157d'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.405192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] The token cache is being invalidate because project 4969b0748cae4180ac89d9149342db17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:49.405436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.406120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.408079 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1186/2385] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:49 2022] DELETE /identity/v3/projects/4969b0748cae4180ac89d9149342db17 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:49.412787 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43313a-3c7a-4b9d-b333-eeaadd0c8b91 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:49.422906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43313a-3c7a-4b9d-b333-eeaadd0c8b91 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:49.467713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:49.487752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b45f4-878b-485e-a2a7-b30fccaec0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:49.488741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b45f4-878b-485e-a2a7-b30fccaec0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:49.489017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b45f4-878b-485e-a2a7-b30fccaec0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:49.489287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b45f4-878b-485e-a2a7-b30fccaec0c2 admin admin] PATH_INFO: `/v3/users/f6dee47f341b459aae033f1cdc760fb7` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:49.490552 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b45f4-878b-485e-a2a7-b30fccaec0c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6dee47f341b459aae033f1cdc760fb7)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:49.492477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b45f4-878b-485e-a2a7-b30fccaec0c2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:49.542332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d92b45f4-878b-485e-a2a7-b30fccaec0c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6dee47f341b459aae033f1cdc760fb7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.542997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d92b45f4-878b-485e-a2a7-b30fccaec0c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6dee47f341b459aae033f1cdc760fb7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.543617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d92b45f4-878b-485e-a2a7-b30fccaec0c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6dee47f341b459aae033f1cdc760fb7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.551590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d92b45f4-878b-485e-a2a7-b30fccaec0c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6dee47f341b459aae033f1cdc760fb7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.560317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d92b45f4-878b-485e-a2a7-b30fccaec0c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6dee47f341b459aae033f1cdc760fb7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.581025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1200/2386] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:49 2022] DELETE /identity/v3/users/f6dee47f341b459aae033f1cdc760fb7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:49.905674 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:49.907220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:49.921995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8f0b0-822e-4f79-8adb-604b8971157d admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:49.936816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:49.989850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:49.990764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:49.991057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:49.991408 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] PATH_INFO: `/v3/projects/48cc0b24f0014eb2b4eaf14d8aa53775` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:49.992764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cc0b24f0014eb2b4eaf14d8aa53775)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:49.995080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.049176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cc0b24f0014eb2b4eaf14d8aa53775', 'request_id': 'req-98698435-de1d-4ebd-81f0-735ec52ae3f3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.058539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cc0b24f0014eb2b4eaf14d8aa53775', 'request_id': 'req-98698435-de1d-4ebd-81f0-735ec52ae3f3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.065660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cc0b24f0014eb2b4eaf14d8aa53775', 'request_id': 'req-98698435-de1d-4ebd-81f0-735ec52ae3f3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.077288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] The token cache is being invalidate because project 48cc0b24f0014eb2b4eaf14d8aa53775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:50.077837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.078548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-98698435-de1d-4ebd-81f0-735ec52ae3f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.080106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1187/2387] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:49 2022] DELETE /identity/v3/projects/48cc0b24f0014eb2b4eaf14d8aa53775 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:50.085872 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd67c-f7a6-4f61-a290-9da481a74265 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.086769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd67c-f7a6-4f61-a290-9da481a74265 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.086971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd67c-f7a6-4f61-a290-9da481a74265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.107168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ad9bd67c-f7a6-4f61-a290-9da481a74265 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:50.108448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ad9bd67c-f7a6-4f61-a290-9da481a74265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:50.181453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1201/2388] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:50.191039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408053e-645b-41cb-8f12-6ee131c259d5 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.191336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408053e-645b-41cb-8f12-6ee131c259d5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.191694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408053e-645b-41cb-8f12-6ee131c259d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.212411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-7408053e-645b-41cb-8f12-6ee131c259d5 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:50.213860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7408053e-645b-41cb-8f12-6ee131c259d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:50.223531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1188/2389] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:50.228256 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bd67c-f7a6-4f61-a290-9da481a74265 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.239416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bd67c-f7a6-4f61-a290-9da481a74265 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.244581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35285b70-dc9d-4fda-a37c-9737756f164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.245264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35285b70-dc9d-4fda-a37c-9737756f164c admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.245547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35285b70-dc9d-4fda-a37c-9737756f164c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.245819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35285b70-dc9d-4fda-a37c-9737756f164c admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.246586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35285b70-dc9d-4fda-a37c-9737756f164c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:50.246896 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35285b70-dc9d-4fda-a37c-9737756f164c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.248533 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35285b70-dc9d-4fda-a37c-9737756f164c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.261757 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1202/2390] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:50.266232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408053e-645b-41cb-8f12-6ee131c259d5 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.276707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408053e-645b-41cb-8f12-6ee131c259d5 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.281818 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6b832-3c10-43c0-b45a-c18ada52242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.282531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b832-3c10-43c0-b45a-c18ada52242c admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.282811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b832-3c10-43c0-b45a-c18ada52242c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.283085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b832-3c10-43c0-b45a-c18ada52242c admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.283793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6b832-3c10-43c0-b45a-c18ada52242c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.286788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6b832-3c10-43c0-b45a-c18ada52242c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.318612 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1189/2391] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:50 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:50.323358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35285b70-dc9d-4fda-a37c-9737756f164c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.334448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35285b70-dc9d-4fda-a37c-9737756f164c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.385243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:50.400748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88551e-ca65-40fd-a3d3-791b5ac90bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.401425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88551e-ca65-40fd-a3d3-791b5ac90bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.401704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88551e-ca65-40fd-a3d3-791b5ac90bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.402031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88551e-ca65-40fd-a3d3-791b5ac90bdd admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.402856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88551e-ca65-40fd-a3d3-791b5ac90bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.405102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88551e-ca65-40fd-a3d3-791b5ac90bdd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.428063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1203/2392] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:50 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:50.432498 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6b832-3c10-43c0-b45a-c18ada52242c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.444412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6b832-3c10-43c0-b45a-c18ada52242c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.450711 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534df70-90b3-42e3-91f4-691b08d57766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.451537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534df70-90b3-42e3-91f4-691b08d57766 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.451950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534df70-90b3-42e3-91f4-691b08d57766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.452364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534df70-90b3-42e3-91f4-691b08d57766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.453486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534df70-90b3-42e3-91f4-691b08d57766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.455420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534df70-90b3-42e3-91f4-691b08d57766 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.474216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1190/2393] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:50.478311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88551e-ca65-40fd-a3d3-791b5ac90bdd admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.489937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88551e-ca65-40fd-a3d3-791b5ac90bdd admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.495692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f180711-12cc-4aa5-a8e8-a1fed2a92e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.496378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180711-12cc-4aa5-a8e8-a1fed2a92e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.496657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180711-12cc-4aa5-a8e8-a1fed2a92e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.496938 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180711-12cc-4aa5-a8e8-a1fed2a92e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.497712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f180711-12cc-4aa5-a8e8-a1fed2a92e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.499435 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f180711-12cc-4aa5-a8e8-a1fed2a92e23 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.512531 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1204/2394] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:50.516616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534df70-90b3-42e3-91f4-691b08d57766 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.529446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534df70-90b3-42e3-91f4-691b08d57766 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.535445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0097d-c4c6-49c8-be52-232b8bdbc66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.536362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0097d-c4c6-49c8-be52-232b8bdbc66e admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.536645 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0097d-c4c6-49c8-be52-232b8bdbc66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.536926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0097d-c4c6-49c8-be52-232b8bdbc66e admin admin] PATH_INFO: `/v3/projects/7c27e5f518b8491697d57c6db1e6e84d/users/d14dfd2957c443399a72079a085862ef/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.560715 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0097d-c4c6-49c8-be52-232b8bdbc66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c27e5f518b8491697d57c6db1e6e84d, user_id=d14dfd2957c443399a72079a085862ef, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.565087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0097d-c4c6-49c8-be52-232b8bdbc66e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.580208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1191/2395] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:50 2022] PUT /identity/v3/projects/7c27e5f518b8491697d57c6db1e6e84d/users/d14dfd2957c443399a72079a085862ef/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:50.592622 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f85a-30b9-4bab-a64a-c624aac3b6e2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.592958 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f85a-30b9-4bab-a64a-c624aac3b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.593253 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f85a-30b9-4bab-a64a-c624aac3b6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.631821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-eeb3f85a-30b9-4bab-a64a-c624aac3b6e2 None None] MFA Rules not processed for user `d14dfd2957c443399a72079a085862ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:50.633714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-eeb3f85a-30b9-4bab-a64a-c624aac3b6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:50.712679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1205/2396] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:50.724805 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0097d-c4c6-49c8-be52-232b8bdbc66e admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.726581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-00a0097d-c4c6-49c8-be52-232b8bdbc66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:50.775228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:50.789241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0097d-c4c6-49c8-be52-232b8bdbc66e admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.792913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61397e-f733-4fb3-a2c8-611dd4fa6be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.793646 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61397e-f733-4fb3-a2c8-611dd4fa6be8 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.794046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61397e-f733-4fb3-a2c8-611dd4fa6be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.794327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61397e-f733-4fb3-a2c8-611dd4fa6be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.805444 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61397e-f733-4fb3-a2c8-611dd4fa6be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.807135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61397e-f733-4fb3-a2c8-611dd4fa6be8 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.818618 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1192/2397] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:50.840481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3f85a-30b9-4bab-a64a-c624aac3b6e2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.908540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3f85a-30b9-4bab-a64a-c624aac3b6e2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.914828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.915718 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.915998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.916270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] PATH_INFO: `/v3/users/d14dfd2957c443399a72079a085862ef` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.917505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14dfd2957c443399a72079a085862ef)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.919553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.978654 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14dfd2957c443399a72079a085862ef'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.979261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14dfd2957c443399a72079a085862ef'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.979872 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14dfd2957c443399a72079a085862ef'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.994809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14dfd2957c443399a72079a085862ef'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.994809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:51.000636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14dfd2957c443399a72079a085862ef'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:51.022111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1206/2398] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:50 2022] DELETE /identity/v3/users/d14dfd2957c443399a72079a085862ef => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:51.027225 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239dead-305b-42e0-9383-7d800ee1e7fc None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:51.027999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239dead-305b-42e0-9383-7d800ee1e7fc None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:51.028220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239dead-305b-42e0-9383-7d800ee1e7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:51.047295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-e239dead-305b-42e0-9383-7d800ee1e7fc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:51.048525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e239dead-305b-42e0-9383-7d800ee1e7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:51.129812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1193/2399] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:51.142287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:51.143844 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:51.232814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d47bbf-5509-40f1-a241-0bf412f07a55 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:51.236495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d8b80-860e-4db7-8dc5-9cdb8dc142e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:51.237838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d8b80-860e-4db7-8dc5-9cdb8dc142e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:51.238279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d8b80-860e-4db7-8dc5-9cdb8dc142e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:51.238716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d8b80-860e-4db7-8dc5-9cdb8dc142e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:51.249544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d8b80-860e-4db7-8dc5-9cdb8dc142e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:51.251252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d8b80-860e-4db7-8dc5-9cdb8dc142e2 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:51.263127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1207/2400] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:51.603008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239dead-305b-42e0-9383-7d800ee1e7fc None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:51.604667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e239dead-305b-42e0-9383-7d800ee1e7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:51.633943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239dead-305b-42e0-9383-7d800ee1e7fc None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:51.640048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:51.641015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:51.641367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:51.641651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] PATH_INFO: `/v3/projects/7c27e5f518b8491697d57c6db1e6e84d` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:51.643030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c27e5f518b8491697d57c6db1e6e84d)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:51.645209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:51.717123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c27e5f518b8491697d57c6db1e6e84d', 'request_id': 'req-a8fc7131-1d4c-42a6-8035-e677f419be33'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:51.729694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c27e5f518b8491697d57c6db1e6e84d', 'request_id': 'req-a8fc7131-1d4c-42a6-8035-e677f419be33'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:51.743340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c27e5f518b8491697d57c6db1e6e84d', 'request_id': 'req-a8fc7131-1d4c-42a6-8035-e677f419be33'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:51.755985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] The token cache is being invalidate because project 7c27e5f518b8491697d57c6db1e6e84d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:51.756363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:51.757091 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a8fc7131-1d4c-42a6-8035-e677f419be33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:51.759639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1194/2401] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:51 2022] DELETE /identity/v3/projects/7c27e5f518b8491697d57c6db1e6e84d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:51.765561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6781-cf86-476c-bc62-9d584b0c76f3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:51.766356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6781-cf86-476c-bc62-9d584b0c76f3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:51.766910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6781-cf86-476c-bc62-9d584b0c76f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:51.798383 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-413d6781-cf86-476c-bc62-9d584b0c76f3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:51.800216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-413d6781-cf86-476c-bc62-9d584b0c76f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:51.874984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1208/2402] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:51.883199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c964d3-c379-461c-9ebd-6327532926a2 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:51.883491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c964d3-c379-461c-9ebd-6327532926a2 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:51.883797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c964d3-c379-461c-9ebd-6327532926a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:51.904878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b5c964d3-c379-461c-9ebd-6327532926a2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:51.906158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b5c964d3-c379-461c-9ebd-6327532926a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:51.915101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1195/2403] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:51.919467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d6781-cf86-476c-bc62-9d584b0c76f3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:51.930086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d6781-cf86-476c-bc62-9d584b0c76f3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:51.935083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044baac-d5aa-4571-ab4f-30a1dd410b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:51.935883 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044baac-d5aa-4571-ab4f-30a1dd410b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:51.936178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044baac-d5aa-4571-ab4f-30a1dd410b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:51.936456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044baac-d5aa-4571-ab4f-30a1dd410b28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:51.937192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044baac-d5aa-4571-ab4f-30a1dd410b28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:51.937500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044baac-d5aa-4571-ab4f-30a1dd410b28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:51.939138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044baac-d5aa-4571-ab4f-30a1dd410b28 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:51.958091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1209/2404] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:03:51.959226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c964d3-c379-461c-9ebd-6327532926a2 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:51.968854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c964d3-c379-461c-9ebd-6327532926a2 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:51.974420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635b42a-1c5f-4b76-af92-52567e27912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:51.975633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b42a-1c5f-4b76-af92-52567e27912d admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:51.975633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b42a-1c5f-4b76-af92-52567e27912d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:51.975875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b42a-1c5f-4b76-af92-52567e27912d admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:51.976391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635b42a-1c5f-4b76-af92-52567e27912d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:51.978487 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635b42a-1c5f-4b76-af92-52567e27912d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:52.010182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1196/2405] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:51 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:52.014207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044baac-d5aa-4571-ab4f-30a1dd410b28 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:52.025595 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044baac-d5aa-4571-ab4f-30a1dd410b28 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:52.086601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd78c3-b82f-4040-b181-bfe4d57bdc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:52.086601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd78c3-b82f-4040-b181-bfe4d57bdc3a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:52.086601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd78c3-b82f-4040-b181-bfe4d57bdc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:52.086601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd78c3-b82f-4040-b181-bfe4d57bdc3a admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:52.087292 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd78c3-b82f-4040-b181-bfe4d57bdc3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:52.089264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd78c3-b82f-4040-b181-bfe4d57bdc3a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:52.100587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:52.112061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1210/2406] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:52 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:52.116588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635b42a-1c5f-4b76-af92-52567e27912d admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:52.127195 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635b42a-1c5f-4b76-af92-52567e27912d admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:52.132787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87fbbf-9163-4f4d-939f-51d507f27dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:52.133457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87fbbf-9163-4f4d-939f-51d507f27dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:52.133740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87fbbf-9163-4f4d-939f-51d507f27dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:52.134053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87fbbf-9163-4f4d-939f-51d507f27dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:52.135046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87fbbf-9163-4f4d-939f-51d507f27dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:52.136651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87fbbf-9163-4f4d-939f-51d507f27dcf admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:52.148212 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1197/2407] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:52.152370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd78c3-b82f-4040-b181-bfe4d57bdc3a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:52.163119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd78c3-b82f-4040-b181-bfe4d57bdc3a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:52.168089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ef4ef-13ac-4b79-8820-1a85ee66e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:52.168758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ef4ef-13ac-4b79-8820-1a85ee66e6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:52.169066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ef4ef-13ac-4b79-8820-1a85ee66e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:52.169348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ef4ef-13ac-4b79-8820-1a85ee66e6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:52.170130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ef4ef-13ac-4b79-8820-1a85ee66e6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:52.171884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ef4ef-13ac-4b79-8820-1a85ee66e6a3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:52.182987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1211/2408] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:52.187352 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87fbbf-9163-4f4d-939f-51d507f27dcf admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:52.198488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87fbbf-9163-4f4d-939f-51d507f27dcf admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:52.203169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca33ee-b769-484d-a413-f634d74881ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:52.204054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca33ee-b769-484d-a413-f634d74881ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:52.204332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca33ee-b769-484d-a413-f634d74881ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:52.204605 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca33ee-b769-484d-a413-f634d74881ea admin admin] PATH_INFO: `/v3/projects/79ee672b3d8c4e18a46b4164308f1ee9/users/d24eda89e91a4645bc7f01d3e59032c3/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:52.222128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca33ee-b769-484d-a413-f634d74881ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ee672b3d8c4e18a46b4164308f1ee9, user_id=d24eda89e91a4645bc7f01d3e59032c3, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:52.224881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca33ee-b769-484d-a413-f634d74881ea admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:52.238002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1198/2409] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:52 2022] PUT /identity/v3/projects/79ee672b3d8c4e18a46b4164308f1ee9/users/d24eda89e91a4645bc7f01d3e59032c3/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:52.243131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d8fd-2d36-40f7-b6e8-2ba3075fd2c6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:52.243422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d8fd-2d36-40f7-b6e8-2ba3075fd2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:52.243700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d8fd-2d36-40f7-b6e8-2ba3075fd2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:52.262304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c357d8fd-2d36-40f7-b6e8-2ba3075fd2c6 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:52.263475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c357d8fd-2d36-40f7-b6e8-2ba3075fd2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:52.323822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1212/2410] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:52.334197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca33ee-b769-484d-a413-f634d74881ea admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:52.335911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0eca33ee-b769-484d-a413-f634d74881ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:52.342698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:52.400398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca33ee-b769-484d-a413-f634d74881ea admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:52.405514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19d21e-f73a-46b0-8f12-0a8c05a0e151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:52.406327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19d21e-f73a-46b0-8f12-0a8c05a0e151 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:52.406613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19d21e-f73a-46b0-8f12-0a8c05a0e151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:52.406898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19d21e-f73a-46b0-8f12-0a8c05a0e151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:52.418317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19d21e-f73a-46b0-8f12-0a8c05a0e151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:52.419810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19d21e-f73a-46b0-8f12-0a8c05a0e151 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:52.431876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1199/2411] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:53.186063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c05c58-6d26-4acb-b853-25dee81d5c08 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:53.186639 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c05c58-6d26-4acb-b853-25dee81d5c08 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:53.187283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c05c58-6d26-4acb-b853-25dee81d5c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:53.223052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-60c05c58-6d26-4acb-b853-25dee81d5c08 None None] MFA Rules not processed for user `d24eda89e91a4645bc7f01d3e59032c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:53.224382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-60c05c58-6d26-4acb-b853-25dee81d5c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:53.308238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1213/2412] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:53.319792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19d21e-f73a-46b0-8f12-0a8c05a0e151 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:53.321260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ca19d21e-f73a-46b0-8f12-0a8c05a0e151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:53.383583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19d21e-f73a-46b0-8f12-0a8c05a0e151 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:53.387946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b08d7-6f85-42e3-b78c-cd608596d492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:53.388613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b08d7-6f85-42e3-b78c-cd608596d492 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:53.388894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b08d7-6f85-42e3-b78c-cd608596d492 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:53.389175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b08d7-6f85-42e3-b78c-cd608596d492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:53.402427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b08d7-6f85-42e3-b78c-cd608596d492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:53.403898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b08d7-6f85-42e3-b78c-cd608596d492 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:53.416641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1200/2413] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:54.799048 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a610-aba3-4576-a8e9-84a31475c966 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:54.800145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a610-aba3-4576-a8e9-84a31475c966 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:54.800145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a610-aba3-4576-a8e9-84a31475c966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:54.819259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-76d5a610-aba3-4576-a8e9-84a31475c966 None None] MFA Rules not processed for user `d24eda89e91a4645bc7f01d3e59032c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:54.820479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-76d5a610-aba3-4576-a8e9-84a31475c966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:54.827827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1214/2414] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:03.410000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=50 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:04.812724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=69 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:17.531113 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa407-2ee5-462f-8d37-fbd7afccc4fe None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:17.531700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa407-2ee5-462f-8d37-fbd7afccc4fe None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:17.531700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa407-2ee5-462f-8d37-fbd7afccc4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:17.550218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ff4fa407-2ee5-462f-8d37-fbd7afccc4fe None None] MFA Rules not processed for user `d24eda89e91a4645bc7f01d3e59032c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:17.551418 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ff4fa407-2ee5-462f-8d37-fbd7afccc4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:17.558639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1201/2415] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:27.544631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:41.049270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b0f38-c8f8-4d3d-9633-c1574467c836 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:41.049832 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b0f38-c8f8-4d3d-9633-c1574467c836 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:41.049979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b0f38-c8f8-4d3d-9633-c1574467c836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:41.069361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9a0b0f38-c8f8-4d3d-9633-c1574467c836 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:41.070903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9a0b0f38-c8f8-4d3d-9633-c1574467c836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:41.138830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1215/2416] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 15:04:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:41.194810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fa407-2ee5-462f-8d37-fbd7afccc4fe None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:41.196269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ff4fa407-2ee5-462f-8d37-fbd7afccc4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:41.276858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fa407-2ee5-462f-8d37-fbd7afccc4fe None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:41.282622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1e6c-c7d5-47b6-83c8-eb57efdc3dc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:41.283124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1e6c-c7d5-47b6-83c8-eb57efdc3dc5 service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:41.283411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1e6c-c7d5-47b6-83c8-eb57efdc3dc5 service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:41.283694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1e6c-c7d5-47b6-83c8-eb57efdc3dc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:41.292898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa1e6c-c7d5-47b6-83c8-eb57efdc3dc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:41.294549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa1e6c-c7d5-47b6-83c8-eb57efdc3dc5 service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:41.303859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1202/2417] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 15:04:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:04:51.131811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=25 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:51.301269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=32 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:57.404865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ef12-e541-49bc-badc-54a26613459c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:57.405632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ef12-e541-49bc-badc-54a26613459c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:57.405632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ef12-e541-49bc-badc-54a26613459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:57.434561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1ee6ef12-e541-49bc-badc-54a26613459c None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:57.435815 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1ee6ef12-e541-49bc-badc-54a26613459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:57.445257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1216/2418] 10.222.0.81 () {58 vars in 967 bytes} [Thu Jun 16 15:04:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:57.462124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1e6c-c7d5-47b6-83c8-eb57efdc3dc5 service swift] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:57.474698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1e6c-c7d5-47b6-83c8-eb57efdc3dc5 service swift] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:57.480303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b1e6a-f927-4264-8942-5b5c5d9a8586 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:57.480989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b1e6a-f927-4264-8942-5b5c5d9a8586 service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:57.481275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b1e6a-f927-4264-8942-5b5c5d9a8586 service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:57.481556 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b1e6a-f927-4264-8942-5b5c5d9a8586 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:57.491915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b1e6a-f927-4264-8942-5b5c5d9a8586 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:57.493558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b1e6a-f927-4264-8942-5b5c5d9a8586 service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:57.503991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1203/2419] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 15:04:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:04:59.479578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ef12-e541-49bc-badc-54a26613459c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:59.481392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1ee6ef12-e541-49bc-badc-54a26613459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:59.544517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b1e6a-f927-4264-8942-5b5c5d9a8586 service swift] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:59.563181 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b1e6a-f927-4264-8942-5b5c5d9a8586 service swift] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:59.568862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46116362-6a3e-4a51-856b-5592f65bcfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:59.569941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46116362-6a3e-4a51-856b-5592f65bcfb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:59.570106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46116362-6a3e-4a51-856b-5592f65bcfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:59.570348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46116362-6a3e-4a51-856b-5592f65bcfb8 admin admin] PATH_INFO: `/v3/users/d24eda89e91a4645bc7f01d3e59032c3` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:59.571579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46116362-6a3e-4a51-856b-5592f65bcfb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24eda89e91a4645bc7f01d3e59032c3)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:59.574541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46116362-6a3e-4a51-856b-5592f65bcfb8 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:59.601437 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ef12-e541-49bc-badc-54a26613459c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:59.612147 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dced1d8-2442-497a-8182-c03ee06e54bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:59.612958 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dced1d8-2442-497a-8182-c03ee06e54bc service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:59.613249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dced1d8-2442-497a-8182-c03ee06e54bc service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:59.613524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dced1d8-2442-497a-8182-c03ee06e54bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:59.615729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8dced1d8-2442-497a-8182-c03ee06e54bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:59.629996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dced1d8-2442-497a-8182-c03ee06e54bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:59.631607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dced1d8-2442-497a-8182-c03ee06e54bc service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:59.644461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1217/2420] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:59.646501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-46116362-6a3e-4a51-856b-5592f65bcfb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24eda89e91a4645bc7f01d3e59032c3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:59.661119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-46116362-6a3e-4a51-856b-5592f65bcfb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24eda89e91a4645bc7f01d3e59032c3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:59.679894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-46116362-6a3e-4a51-856b-5592f65bcfb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24eda89e91a4645bc7f01d3e59032c3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:59.680577 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-46116362-6a3e-4a51-856b-5592f65bcfb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24eda89e91a4645bc7f01d3e59032c3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:59.689394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-46116362-6a3e-4a51-856b-5592f65bcfb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24eda89e91a4645bc7f01d3e59032c3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:59.697289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1204/2421] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:59 2022] DELETE /identity/v3/users/d24eda89e91a4645bc7f01d3e59032c3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:59.890526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dced1d8-2442-497a-8182-c03ee06e54bc service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:59.901634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dced1d8-2442-497a-8182-c03ee06e54bc service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:59.966369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:59.967237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:59.967516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:59.967784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] PATH_INFO: `/v3/projects/79ee672b3d8c4e18a46b4164308f1ee9` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:59.969561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ee672b3d8c4e18a46b4164308f1ee9)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:59.971603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:00.024258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ee672b3d8c4e18a46b4164308f1ee9', 'request_id': 'req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:00.033023 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ee672b3d8c4e18a46b4164308f1ee9', 'request_id': 'req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:00.040019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ee672b3d8c4e18a46b4164308f1ee9', 'request_id': 'req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:00.052790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] The token cache is being invalidate because project 79ee672b3d8c4e18a46b4164308f1ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:00.053085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:00.053756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-33dee97a-5ad8-40e3-bf09-58c4e2704ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:00.055402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1218/2422] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:59 2022] DELETE /identity/v3/projects/79ee672b3d8c4e18a46b4164308f1ee9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:00.061409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815d8ac-d29d-493a-9f2e-e30f832dacba None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.061787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815d8ac-d29d-493a-9f2e-e30f832dacba None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.062120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815d8ac-d29d-493a-9f2e-e30f832dacba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.084416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a815d8ac-d29d-493a-9f2e-e30f832dacba None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:00.085791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a815d8ac-d29d-493a-9f2e-e30f832dacba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:00.152548 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1205/2423] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:00.161285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a813-6d63-4a50-b392-993c05562984 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.161572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a813-6d63-4a50-b392-993c05562984 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.161906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a813-6d63-4a50-b392-993c05562984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.180972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-0811a813-6d63-4a50-b392-993c05562984 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:00.182228 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0811a813-6d63-4a50-b392-993c05562984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:00.191085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1219/2424] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:00.195416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815d8ac-d29d-493a-9f2e-e30f832dacba None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:00.205754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815d8ac-d29d-493a-9f2e-e30f832dacba None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:00.210447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862ca41-0631-46c2-b05e-f544725b96cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:00.211112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ca41-0631-46c2-b05e-f544725b96cf admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.211396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ca41-0631-46c2-b05e-f544725b96cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.211675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ca41-0631-46c2-b05e-f544725b96cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.212428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862ca41-0631-46c2-b05e-f544725b96cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:00.212738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862ca41-0631-46c2-b05e-f544725b96cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:00.214391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862ca41-0631-46c2-b05e-f544725b96cf admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:00.227183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1206/2425] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:00.235325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811a813-6d63-4a50-b392-993c05562984 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:00.245262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811a813-6d63-4a50-b392-993c05562984 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:00.255869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5e0d2-a274-41ff-87c2-9a686d10a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:00.256601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5e0d2-a274-41ff-87c2-9a686d10a056 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.256884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5e0d2-a274-41ff-87c2-9a686d10a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.257168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5e0d2-a274-41ff-87c2-9a686d10a056 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.257876 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5e0d2-a274-41ff-87c2-9a686d10a056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:00.260114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5e0d2-a274-41ff-87c2-9a686d10a056 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:00.263814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:00.294143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1220/2426] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:00 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:00.295485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862ca41-0631-46c2-b05e-f544725b96cf admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:00.305967 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862ca41-0631-46c2-b05e-f544725b96cf admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:00.354456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:00.369730 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01391061-8434-4936-a724-d864d5f2bd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:00.370445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01391061-8434-4936-a724-d864d5f2bd0b admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.370735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01391061-8434-4936-a724-d864d5f2bd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.371018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01391061-8434-4936-a724-d864d5f2bd0b admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.371712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01391061-8434-4936-a724-d864d5f2bd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:00.373655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01391061-8434-4936-a724-d864d5f2bd0b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:00.398978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1207/2427] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:00 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:00.400291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5e0d2-a274-41ff-87c2-9a686d10a056 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:00.411931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5e0d2-a274-41ff-87c2-9a686d10a056 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:00.417511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9aa2c-2f98-44d0-a03e-4b73e5ccbbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:00.418220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9aa2c-2f98-44d0-a03e-4b73e5ccbbaa admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.418508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9aa2c-2f98-44d0-a03e-4b73e5ccbbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.418788 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9aa2c-2f98-44d0-a03e-4b73e5ccbbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.419529 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9aa2c-2f98-44d0-a03e-4b73e5ccbbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:00.421139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9aa2c-2f98-44d0-a03e-4b73e5ccbbaa admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:00.433394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1221/2428] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:00.438915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01391061-8434-4936-a724-d864d5f2bd0b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:00.449157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01391061-8434-4936-a724-d864d5f2bd0b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:00.454991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2c4aa-9585-47a7-baf0-555d8ef8c0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:00.455370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2c4aa-9585-47a7-baf0-555d8ef8c0fb admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.455655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2c4aa-9585-47a7-baf0-555d8ef8c0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.455954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2c4aa-9585-47a7-baf0-555d8ef8c0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.456656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2c4aa-9585-47a7-baf0-555d8ef8c0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:00.458298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2c4aa-9585-47a7-baf0-555d8ef8c0fb admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:00.469012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1208/2429] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:00.473849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9aa2c-2f98-44d0-a03e-4b73e5ccbbaa admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:00.485793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9aa2c-2f98-44d0-a03e-4b73e5ccbbaa admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:00.490839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf979e1-120f-4956-abfc-59cdbd52a84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:00.491735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf979e1-120f-4956-abfc-59cdbd52a84b admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.492020 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf979e1-120f-4956-abfc-59cdbd52a84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.492297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf979e1-120f-4956-abfc-59cdbd52a84b admin admin] PATH_INFO: `/v3/projects/1824c49c4c6f483389729fdd75b6108d/users/288172aa07644958a4eeacc37848a435/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.511589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf979e1-120f-4956-abfc-59cdbd52a84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1824c49c4c6f483389729fdd75b6108d, user_id=288172aa07644958a4eeacc37848a435, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:00.514304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf979e1-120f-4956-abfc-59cdbd52a84b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:00.532099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1222/2430] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:00 2022] PUT /identity/v3/projects/1824c49c4c6f483389729fdd75b6108d/users/288172aa07644958a4eeacc37848a435/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:00.546539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f43f-236c-4259-9a55-dacbb9713f3f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.547070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f43f-236c-4259-9a55-dacbb9713f3f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.547070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f43f-236c-4259-9a55-dacbb9713f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.576872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b060f43f-236c-4259-9a55-dacbb9713f3f None None] MFA Rules not processed for user `288172aa07644958a4eeacc37848a435`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:00.578261 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b060f43f-236c-4259-9a55-dacbb9713f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:00.653850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1209/2431] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:05:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:00.668625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf979e1-120f-4956-abfc-59cdbd52a84b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:00.670402 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-edf979e1-120f-4956-abfc-59cdbd52a84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:00.729474 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf979e1-120f-4956-abfc-59cdbd52a84b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:00.733212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8e023-45f5-4d34-9834-12a12af4fd26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:00.733964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e023-45f5-4d34-9834-12a12af4fd26 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.734202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e023-45f5-4d34-9834-12a12af4fd26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.735975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e023-45f5-4d34-9834-12a12af4fd26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.744624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8e023-45f5-4d34-9834-12a12af4fd26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:00.746300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8e023-45f5-4d34-9834-12a12af4fd26 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:00.756781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1223/2432] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:10.650592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:10.752083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:12.266885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060f43f-236c-4259-9a55-dacbb9713f3f None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:12.338180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060f43f-236c-4259-9a55-dacbb9713f3f None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:12.342738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:12.343705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.343973 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.344251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] PATH_INFO: `/v3/users/288172aa07644958a4eeacc37848a435` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.345461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=288172aa07644958a4eeacc37848a435)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:12.347408 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:12.398546 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288172aa07644958a4eeacc37848a435'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.405397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288172aa07644958a4eeacc37848a435'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.417900 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288172aa07644958a4eeacc37848a435'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.418633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288172aa07644958a4eeacc37848a435'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.426428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288172aa07644958a4eeacc37848a435'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.432407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1210/2433] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:12 2022] DELETE /identity/v3/users/288172aa07644958a4eeacc37848a435 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:12.438007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5ebd1-391b-4f36-a322-c6f82cfd6626 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.438528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5ebd1-391b-4f36-a322-c6f82cfd6626 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.438647 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5ebd1-391b-4f36-a322-c6f82cfd6626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.455931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-05e5ebd1-391b-4f36-a322-c6f82cfd6626 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:12.457132 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-05e5ebd1-391b-4f36-a322-c6f82cfd6626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:12.518593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1224/2434] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:12.528810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:12.530385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:12.588748 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b3d3-168d-49d9-aa77-cdc98e331abf admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:12.592483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e28901-5897-429e-a82d-77de3ea2540b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:12.593130 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e28901-5897-429e-a82d-77de3ea2540b service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.593416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e28901-5897-429e-a82d-77de3ea2540b service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.593698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e28901-5897-429e-a82d-77de3ea2540b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.603235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e28901-5897-429e-a82d-77de3ea2540b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:12.604665 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e28901-5897-429e-a82d-77de3ea2540b service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:12.615640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1211/2435] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:12.946608 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5ebd1-391b-4f36-a322-c6f82cfd6626 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:12.948166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-05e5ebd1-391b-4f36-a322-c6f82cfd6626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:12.964260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5ebd1-391b-4f36-a322-c6f82cfd6626 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:12.973448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:12.975008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.975526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.976024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] PATH_INFO: `/v3/projects/1824c49c4c6f483389729fdd75b6108d` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.978136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1824c49c4c6f483389729fdd75b6108d)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:12.981339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.037463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1824c49c4c6f483389729fdd75b6108d', 'request_id': 'req-a142506a-3189-4913-abed-e733be0aba9f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:13.048081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1824c49c4c6f483389729fdd75b6108d', 'request_id': 'req-a142506a-3189-4913-abed-e733be0aba9f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:13.055384 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1824c49c4c6f483389729fdd75b6108d', 'request_id': 'req-a142506a-3189-4913-abed-e733be0aba9f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:13.067258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] The token cache is being invalidate because project 1824c49c4c6f483389729fdd75b6108d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:13.067615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:13.068526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a142506a-3189-4913-abed-e733be0aba9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:13.070123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1225/2436] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:12 2022] DELETE /identity/v3/projects/1824c49c4c6f483389729fdd75b6108d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:13.075055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9e001-1b93-4fb1-882a-012bd393ca20 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.075347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9e001-1b93-4fb1-882a-012bd393ca20 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.075626 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9e001-1b93-4fb1-882a-012bd393ca20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.093873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-fdf9e001-1b93-4fb1-882a-012bd393ca20 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:13.095247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-fdf9e001-1b93-4fb1-882a-012bd393ca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:13.118101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:13.167253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1212/2437] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:13.176236 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4acef4-9c6c-48cc-aa32-663fdb54e196 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.176524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4acef4-9c6c-48cc-aa32-663fdb54e196 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.176837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4acef4-9c6c-48cc-aa32-663fdb54e196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.196533 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9d4acef4-9c6c-48cc-aa32-663fdb54e196 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:13.197773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9d4acef4-9c6c-48cc-aa32-663fdb54e196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:13.206754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1226/2438] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:13.211211 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9e001-1b93-4fb1-882a-012bd393ca20 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.221429 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9e001-1b93-4fb1-882a-012bd393ca20 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.226727 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a0e30-8fd1-4e59-9481-fa1b0524c88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.227404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a0e30-8fd1-4e59-9481-fa1b0524c88b admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.227689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a0e30-8fd1-4e59-9481-fa1b0524c88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.227963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a0e30-8fd1-4e59-9481-fa1b0524c88b admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.228694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a0e30-8fd1-4e59-9481-fa1b0524c88b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:13.229019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a0e30-8fd1-4e59-9481-fa1b0524c88b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.230658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a0e30-8fd1-4e59-9481-fa1b0524c88b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.244933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1213/2439] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:13.250140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4acef4-9c6c-48cc-aa32-663fdb54e196 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.262006 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4acef4-9c6c-48cc-aa32-663fdb54e196 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.267962 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe342b4-af82-4d42-8fe5-f298a4d31d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.268634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe342b4-af82-4d42-8fe5-f298a4d31d65 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.268920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe342b4-af82-4d42-8fe5-f298a4d31d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.269198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe342b4-af82-4d42-8fe5-f298a4d31d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.269932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe342b4-af82-4d42-8fe5-f298a4d31d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.271857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe342b4-af82-4d42-8fe5-f298a4d31d65 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.309832 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1227/2440] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:13 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:13.315133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a0e30-8fd1-4e59-9481-fa1b0524c88b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.325223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a0e30-8fd1-4e59-9481-fa1b0524c88b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.387609 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b877887-bb10-4d52-90cf-cc1f3b0af700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.388284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b877887-bb10-4d52-90cf-cc1f3b0af700 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.388566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b877887-bb10-4d52-90cf-cc1f3b0af700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.388840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b877887-bb10-4d52-90cf-cc1f3b0af700 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.389532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b877887-bb10-4d52-90cf-cc1f3b0af700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.391553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b877887-bb10-4d52-90cf-cc1f3b0af700 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.416079 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1214/2441] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:13 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:13.417326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe342b4-af82-4d42-8fe5-f298a4d31d65 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.429039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe342b4-af82-4d42-8fe5-f298a4d31d65 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.433721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd57b6a-3aa0-4623-92f1-cf27ff1ae8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.434411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd57b6a-3aa0-4623-92f1-cf27ff1ae8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.434694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd57b6a-3aa0-4623-92f1-cf27ff1ae8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.434968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd57b6a-3aa0-4623-92f1-cf27ff1ae8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.435692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd57b6a-3aa0-4623-92f1-cf27ff1ae8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.438603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd57b6a-3aa0-4623-92f1-cf27ff1ae8f2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.449578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1228/2442] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:05:13.454070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b877887-bb10-4d52-90cf-cc1f3b0af700 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.465059 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b877887-bb10-4d52-90cf-cc1f3b0af700 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.471239 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a776f-da43-46dd-8f79-053d4e9204ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.471921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a776f-da43-46dd-8f79-053d4e9204ea admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.472204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a776f-da43-46dd-8f79-053d4e9204ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.472479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a776f-da43-46dd-8f79-053d4e9204ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.473217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a776f-da43-46dd-8f79-053d4e9204ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.474865 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a776f-da43-46dd-8f79-053d4e9204ea admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.486914 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1215/2443] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:13.491191 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd57b6a-3aa0-4623-92f1-cf27ff1ae8f2 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.502581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd57b6a-3aa0-4623-92f1-cf27ff1ae8f2 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.507212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a7313-455b-4c0e-9269-47007553c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.508135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7313-455b-4c0e-9269-47007553c327 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.508419 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7313-455b-4c0e-9269-47007553c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.508960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7313-455b-4c0e-9269-47007553c327 admin admin] PATH_INFO: `/v3/projects/bd163ce773a149819901625613570fcf/users/2eb8e7ee469d426388e4cba3f6830f3b/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.526981 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a7313-455b-4c0e-9269-47007553c327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd163ce773a149819901625613570fcf, user_id=2eb8e7ee469d426388e4cba3f6830f3b, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.529669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a7313-455b-4c0e-9269-47007553c327 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.544288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1229/2444] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:13 2022] PUT /identity/v3/projects/bd163ce773a149819901625613570fcf/users/2eb8e7ee469d426388e4cba3f6830f3b/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:13.550833 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc6d6c-6d93-48a3-963e-3780abf8a9ad None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.551123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc6d6c-6d93-48a3-963e-3780abf8a9ad None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.551402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc6d6c-6d93-48a3-963e-3780abf8a9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.570142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-f1bc6d6c-6d93-48a3-963e-3780abf8a9ad None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:13.571282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f1bc6d6c-6d93-48a3-963e-3780abf8a9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:13.649102 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1216/2445] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:13.659558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a7313-455b-4c0e-9269-47007553c327 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.661473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-425a7313-455b-4c0e-9269-47007553c327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:13.686921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:13.724910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a7313-455b-4c0e-9269-47007553c327 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.728563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe6ee4-9e88-4d85-98f5-36d205e3b0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.729204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe6ee4-9e88-4d85-98f5-36d205e3b0ff service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.729481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe6ee4-9e88-4d85-98f5-36d205e3b0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.729752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe6ee4-9e88-4d85-98f5-36d205e3b0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.739675 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe6ee4-9e88-4d85-98f5-36d205e3b0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.741082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe6ee4-9e88-4d85-98f5-36d205e3b0ff service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.750647 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1230/2446] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:14.383702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f190f-c8c4-43cb-9f97-ae7de51d7d80 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:14.384247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f190f-c8c4-43cb-9f97-ae7de51d7d80 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:14.384247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f190f-c8c4-43cb-9f97-ae7de51d7d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:14.413260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-820f190f-c8c4-43cb-9f97-ae7de51d7d80 None None] MFA Rules not processed for user `2eb8e7ee469d426388e4cba3f6830f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:14.414458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-820f190f-c8c4-43cb-9f97-ae7de51d7d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:14.432263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:14.486985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1217/2447] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:05:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:14.497554 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe6ee4-9e88-4d85-98f5-36d205e3b0ff service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:14.499016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8ebe6ee4-9e88-4d85-98f5-36d205e3b0ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:14.559243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe6ee4-9e88-4d85-98f5-36d205e3b0ff service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:14.563128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a1080-e474-4e98-91c8-56bf822a60af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:14.563801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1080-e474-4e98-91c8-56bf822a60af service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:14.564082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1080-e474-4e98-91c8-56bf822a60af service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:14.564414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1080-e474-4e98-91c8-56bf822a60af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:14.573651 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a1080-e474-4e98-91c8-56bf822a60af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:14.575144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a1080-e474-4e98-91c8-56bf822a60af service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:14.584616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1231/2448] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:17.013768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e5acb-7a84-4469-838f-023f56da411e None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:17.014576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e5acb-7a84-4469-838f-023f56da411e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:17.014576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e5acb-7a84-4469-838f-023f56da411e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:17.033280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-788e5acb-7a84-4469-838f-023f56da411e None None] MFA Rules not processed for user `2eb8e7ee469d426388e4cba3f6830f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:17.034530 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-788e5acb-7a84-4469-838f-023f56da411e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:17.041515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1218/2449] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:05:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:24.580035 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=43 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:26.323117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a1080-e474-4e98-91c8-56bf822a60af service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:26.324613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dc9a1080-e474-4e98-91c8-56bf822a60af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:26.338605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a1080-e474-4e98-91c8-56bf822a60af service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:26.343741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d79bf-ea9f-494c-870a-7d7e8d83f913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:26.344403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d79bf-ea9f-494c-870a-7d7e8d83f913 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:26.344681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d79bf-ea9f-494c-870a-7d7e8d83f913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:26.344956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d79bf-ea9f-494c-870a-7d7e8d83f913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:26.347024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3a0d79bf-ea9f-494c-870a-7d7e8d83f913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:26.450176 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d79bf-ea9f-494c-870a-7d7e8d83f913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:26.451640 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d79bf-ea9f-494c-870a-7d7e8d83f913 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:26.464136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1232/2450] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:27.027811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=22 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:28.381278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e5acb-7a84-4469-838f-023f56da411e None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:28.392250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e5acb-7a84-4469-838f-023f56da411e None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:28.395841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a054642-9687-43d2-936f-d274d1034552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:28.396489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a054642-9687-43d2-936f-d274d1034552 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:28.396774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a054642-9687-43d2-936f-d274d1034552 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:28.397052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a054642-9687-43d2-936f-d274d1034552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:28.398824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6a054642-9687-43d2-936f-d274d1034552 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:28.414301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a054642-9687-43d2-936f-d274d1034552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:28.415686 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a054642-9687-43d2-936f-d274d1034552 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:28.426907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1219/2451] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:36.461202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=34 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:38.422254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=6 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:41.288910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c24f1-db6f-4922-8a6d-5cd6b4ab6eac None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:41.289495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c24f1-db6f-4922-8a6d-5cd6b4ab6eac None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:41.289495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c24f1-db6f-4922-8a6d-5cd6b4ab6eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:41.334840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-845c24f1-db6f-4922-8a6d-5cd6b4ab6eac None None] MFA Rules not processed for user `7efff0603fb7461ca799c67a8050e181`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:41.336079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-845c24f1-db6f-4922-8a6d-5cd6b4ab6eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:41.396146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1233/2452] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:43.398112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a054642-9687-43d2-936f-d274d1034552 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:43.399666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-6a054642-9687-43d2-936f-d274d1034552 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:43.417411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a054642-9687-43d2-936f-d274d1034552 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:43.424829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79890-cb8a-4635-ba46-6e5bddb7a432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:43.425536 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79890-cb8a-4635-ba46-6e5bddb7a432 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:43.425785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79890-cb8a-4635-ba46-6e5bddb7a432 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:43.426087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79890-cb8a-4635-ba46-6e5bddb7a432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:43.427923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-44a79890-cb8a-4635-ba46-6e5bddb7a432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:43.560269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a79890-cb8a-4635-ba46-6e5bddb7a432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:43.563106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a79890-cb8a-4635-ba46-6e5bddb7a432 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:43.577709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1220/2453] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:51.387264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=34 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:53.304143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024974c-1bd5-4924-876c-7cb5f8f3a661 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:53.304766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024974c-1bd5-4924-876c-7cb5f8f3a661 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:53.305078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024974c-1bd5-4924-876c-7cb5f8f3a661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:53.330223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a024974c-1bd5-4924-876c-7cb5f8f3a661 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:53.331593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a024974c-1bd5-4924-876c-7cb5f8f3a661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:53.416597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1234/2454] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 15:05:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:53.442199 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79890-cb8a-4635-ba46-6e5bddb7a432 service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:53.443756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-44a79890-cb8a-4635-ba46-6e5bddb7a432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:53.537342 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79890-cb8a-4635-ba46-6e5bddb7a432 service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:53.542401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81578115-e93a-4b3d-8b8f-7ac39b57ef3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:53.543092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81578115-e93a-4b3d-8b8f-7ac39b57ef3d service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:53.543371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81578115-e93a-4b3d-8b8f-7ac39b57ef3d service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:53.543642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81578115-e93a-4b3d-8b8f-7ac39b57ef3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:53.552922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81578115-e93a-4b3d-8b8f-7ac39b57ef3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:53.554591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81578115-e93a-4b3d-8b8f-7ac39b57ef3d service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:53.568755 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1221/2455] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 15:05:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:06:00.665279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024974c-1bd5-4924-876c-7cb5f8f3a661 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:00.687222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024974c-1bd5-4924-876c-7cb5f8f3a661 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:00.692285 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e42f5-0979-4d44-bf98-801942659dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:00.693230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e42f5-0979-4d44-bf98-801942659dea service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:00.693681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e42f5-0979-4d44-bf98-801942659dea service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:00.694488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e42f5-0979-4d44-bf98-801942659dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:00.697197 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-907e42f5-0979-4d44-bf98-801942659dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:00.710973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e42f5-0979-4d44-bf98-801942659dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:00.714158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e42f5-0979-4d44-bf98-801942659dea service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:00.738275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1235/2456] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:03.563887 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=69 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:04.692349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81578115-e93a-4b3d-8b8f-7ac39b57ef3d service swift] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:04.713657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81578115-e93a-4b3d-8b8f-7ac39b57ef3d service swift] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:04.719343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016b5d2-e1a3-485b-ba53-12f09cc3b3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:04.720752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b5d2-e1a3-485b-ba53-12f09cc3b3be service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:04.721107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b5d2-e1a3-485b-ba53-12f09cc3b3be service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:04.721509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b5d2-e1a3-485b-ba53-12f09cc3b3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:04.723396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0016b5d2-e1a3-485b-ba53-12f09cc3b3be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:04.821255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016b5d2-e1a3-485b-ba53-12f09cc3b3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:04.823416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016b5d2-e1a3-485b-ba53-12f09cc3b3be service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:04.838978 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1222/2457] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:06:05.411555 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94cb1-726a-4ac3-963e-deba6a942dcc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:05.412189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94cb1-726a-4ac3-963e-deba6a942dcc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:05.412189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94cb1-726a-4ac3-963e-deba6a942dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:05.441529 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7fc94cb1-726a-4ac3-963e-deba6a942dcc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:05.443414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7fc94cb1-726a-4ac3-963e-deba6a942dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:05.454341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1236/2458] 10.222.0.90 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:05.481754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016b5d2-e1a3-485b-ba53-12f09cc3b3be service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:05.501774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016b5d2-e1a3-485b-ba53-12f09cc3b3be service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:05.509105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e48b5-0cfc-4b59-bb03-88b05a2b6084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:05.510288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e48b5-0cfc-4b59-bb03-88b05a2b6084 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:05.510850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e48b5-0cfc-4b59-bb03-88b05a2b6084 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:05.511386 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e48b5-0cfc-4b59-bb03-88b05a2b6084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:05.522489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e48b5-0cfc-4b59-bb03-88b05a2b6084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:05.524958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e48b5-0cfc-4b59-bb03-88b05a2b6084 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:05.550824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1223/2459] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:11.574391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a17ad-2d43-4909-bd37-3e44a40047ae None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:11.574967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a17ad-2d43-4909-bd37-3e44a40047ae None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:11.575088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a17ad-2d43-4909-bd37-3e44a40047ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:11.596573 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cc3a17ad-2d43-4909-bd37-3e44a40047ae None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:11.598218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cc3a17ad-2d43-4909-bd37-3e44a40047ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:11.606895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1237/2460] 10.222.0.90 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:06:11.642543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e48b5-0cfc-4b59-bb03-88b05a2b6084 service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:11.654996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e48b5-0cfc-4b59-bb03-88b05a2b6084 service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:11.661050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb0314-dde7-441e-90c0-a3a87b211e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:11.661716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb0314-dde7-441e-90c0-a3a87b211e12 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:11.662032 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb0314-dde7-441e-90c0-a3a87b211e12 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:11.662305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb0314-dde7-441e-90c0-a3a87b211e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:11.671910 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb0314-dde7-441e-90c0-a3a87b211e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:11.673530 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb0314-dde7-441e-90c0-a3a87b211e12 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:11.683841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1224/2461] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:17.055105 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bdd48-d87e-45d7-9001-c9a1eab90824 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.056029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bdd48-d87e-45d7-9001-c9a1eab90824 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.056476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bdd48-d87e-45d7-9001-c9a1eab90824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.081265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6a1bdd48-d87e-45d7-9001-c9a1eab90824 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:17.083762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6a1bdd48-d87e-45d7-9001-c9a1eab90824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:17.096718 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1238/2462] 10.222.0.90 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:17.126428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb0314-dde7-441e-90c0-a3a87b211e12 service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:17.143683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb0314-dde7-441e-90c0-a3a87b211e12 service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:17.150888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac067fc4-b079-4de5-a036-19819224ca07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:17.151790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067fc4-b079-4de5-a036-19819224ca07 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.152340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067fc4-b079-4de5-a036-19819224ca07 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.152625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067fc4-b079-4de5-a036-19819224ca07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.171238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac067fc4-b079-4de5-a036-19819224ca07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:17.173719 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac067fc4-b079-4de5-a036-19819224ca07 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:17.208124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1225/2463] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:06:17.480838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bdd48-d87e-45d7-9001-c9a1eab90824 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:17.492316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bdd48-d87e-45d7-9001-c9a1eab90824 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:17.495874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12664b7-0cd1-4f0e-9ba4-84112dcd76b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:17.496529 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12664b7-0cd1-4f0e-9ba4-84112dcd76b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.496818 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12664b7-0cd1-4f0e-9ba4-84112dcd76b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.497111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12664b7-0cd1-4f0e-9ba4-84112dcd76b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.499277 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b12664b7-0cd1-4f0e-9ba4-84112dcd76b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:17.512752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12664b7-0cd1-4f0e-9ba4-84112dcd76b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:17.514370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12664b7-0cd1-4f0e-9ba4-84112dcd76b2 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:17.524700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1239/2464] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:23.022298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b0e5-8c5a-4663-85fd-e65a3118de33 None None] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:23.022884 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b0e5-8c5a-4663-85fd-e65a3118de33 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:23.022884 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b0e5-8c5a-4663-85fd-e65a3118de33 None None] PATH_INFO: `/` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:23.024756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1226/2465] 10.222.0.81 () {54 vars in 921 bytes} [Thu Jun 16 15:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:06:23.032260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847260-1e08-4c01-9839-c28d8460d589 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:23.032805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847260-1e08-4c01-9839-c28d8460d589 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:23.032805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847260-1e08-4c01-9839-c28d8460d589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:23.039686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=47 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:23.055999 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5f847260-1e08-4c01-9839-c28d8460d589 None None] MFA Rules not processed for user `f2faa046b0294a0ba1090be84bb1cebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:23.057476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5f847260-1e08-4c01-9839-c28d8460d589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:23.073202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1240/2466] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Jun 16 15:06:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:23.086689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1b0e5-8c5a-4663-85fd-e65a3118de33 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:23.088701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f2f1b0e5-8c5a-4663-85fd-e65a3118de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:23.164955 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1b0e5-8c5a-4663-85fd-e65a3118de33 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:23.168769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ca64f-2c29-4344-8c3b-9b05281908de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9c1cc51e544c90a629feb312a80c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:23.169690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ca64f-2c29-4344-8c3b-9b05281908de service glance] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:23.170127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ca64f-2c29-4344-8c3b-9b05281908de service glance] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:23.170411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ca64f-2c29-4344-8c3b-9b05281908de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:23.185234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ca64f-2c29-4344-8c3b-9b05281908de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:23.186963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ca64f-2c29-4344-8c3b-9b05281908de service glance] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:23.202135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1227/2467] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:25.159300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b45ba-3918-4c55-b404-e0bd47b0227c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:25.160186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b45ba-3918-4c55-b404-e0bd47b0227c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:25.160741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b45ba-3918-4c55-b404-e0bd47b0227c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:25.184150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-0d5b45ba-3918-4c55-b404-e0bd47b0227c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:25.186908 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0d5b45ba-3918-4c55-b404-e0bd47b0227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:25.187765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ca64f-2c29-4344-8c3b-9b05281908de service glance] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:25.189740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1e1ca64f-2c29-4344-8c3b-9b05281908de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:25.196379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1241/2468] 10.222.0.90 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:25.212662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ca64f-2c29-4344-8c3b-9b05281908de service glance] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:25.222998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:25.224054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:25.224337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:25.224614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] PATH_INFO: `/v3/users/d215812d468540c199503d16357cf4a0` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:25.226054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d215812d468540c199503d16357cf4a0)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:25.228734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:25.235858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b45ba-3918-4c55-b404-e0bd47b0227c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:25.237364 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0d5b45ba-3918-4c55-b404-e0bd47b0227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:25.268076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b45ba-3918-4c55-b404-e0bd47b0227c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:25.279925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24acd04-f8a7-4488-8efc-b5ce52bd45a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:25.280633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24acd04-f8a7-4488-8efc-b5ce52bd45a8 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:25.281113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24acd04-f8a7-4488-8efc-b5ce52bd45a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:25.281646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24acd04-f8a7-4488-8efc-b5ce52bd45a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:25.291838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24acd04-f8a7-4488-8efc-b5ce52bd45a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:25.293440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24acd04-f8a7-4488-8efc-b5ce52bd45a8 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:25.302347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd215812d468540c199503d16357cf4a0'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.312257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd215812d468540c199503d16357cf4a0'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.314219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:25.320401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1242/2469] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:25.335747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd215812d468540c199503d16357cf4a0'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.336632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd215812d468540c199503d16357cf4a0'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.348178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd215812d468540c199503d16357cf4a0'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.361424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1228/2470] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:06:25 2022] DELETE /identity/v3/users/d215812d468540c199503d16357cf4a0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:06:25.623655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24acd04-f8a7-4488-8efc-b5ce52bd45a8 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:25.635107 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24acd04-f8a7-4488-8efc-b5ce52bd45a8 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:25.704840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:25.705821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:25.706140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:25.706413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] PATH_INFO: `/v3/projects/aff79be6c0d441d98eb5b67f2d68137d` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:25.707643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff79be6c0d441d98eb5b67f2d68137d)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:25.709728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:25.760556 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff79be6c0d441d98eb5b67f2d68137d', 'request_id': 'req-72031601-7a31-46b3-bfde-4547edaf3dff'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.769200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff79be6c0d441d98eb5b67f2d68137d', 'request_id': 'req-72031601-7a31-46b3-bfde-4547edaf3dff'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.776411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff79be6c0d441d98eb5b67f2d68137d', 'request_id': 'req-72031601-7a31-46b3-bfde-4547edaf3dff'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.788824 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] The token cache is being invalidate because project aff79be6c0d441d98eb5b67f2d68137d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:06:25.789109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.791907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.793502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1243/2471] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:06:25 2022] DELETE /identity/v3/projects/aff79be6c0d441d98eb5b67f2d68137d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:25.798392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:25.799940 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:25.818816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f966f-44c3-41e2-9220-1da94e9faf06 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:25.880560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0bcf0-0d0c-4b1a-93e0-a9082a6b4f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:25.881443 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0bcf0-0d0c-4b1a-93e0-a9082a6b4f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:25.881723 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0bcf0-0d0c-4b1a-93e0-a9082a6b4f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:25.882039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0bcf0-0d0c-4b1a-93e0-a9082a6b4f32 admin admin] PATH_INFO: `/v3/users/8b5c7c777ed84477b3e3afe408694768` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:25.883518 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0bcf0-0d0c-4b1a-93e0-a9082a6b4f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5c7c777ed84477b3e3afe408694768)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:25.885554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0bcf0-0d0c-4b1a-93e0-a9082a6b4f32 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:25.944139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b9b0bcf0-0d0c-4b1a-93e0-a9082a6b4f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5c7c777ed84477b3e3afe408694768'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.951189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b9b0bcf0-0d0c-4b1a-93e0-a9082a6b4f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5c7c777ed84477b3e3afe408694768'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.964638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b9b0bcf0-0d0c-4b1a-93e0-a9082a6b4f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5c7c777ed84477b3e3afe408694768'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.965376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b9b0bcf0-0d0c-4b1a-93e0-a9082a6b4f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5c7c777ed84477b3e3afe408694768'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.974185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b9b0bcf0-0d0c-4b1a-93e0-a9082a6b4f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5c7c777ed84477b3e3afe408694768'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:25.980401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1229/2472] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:06:25 2022] DELETE /identity/v3/users/8b5c7c777ed84477b3e3afe408694768 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:26.177458 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:26.179562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:26.200734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72031601-7a31-46b3-bfde-4547edaf3dff admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:26.281867 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:26.282759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:26.283046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:26.283320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] PATH_INFO: `/v3/projects/ceee87ee031d4217b819496140c79a11` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:26.284546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceee87ee031d4217b819496140c79a11)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:26.286510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:26.295716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:26.339297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceee87ee031d4217b819496140c79a11', 'request_id': 'req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:26.347384 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceee87ee031d4217b819496140c79a11', 'request_id': 'req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:26.354120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceee87ee031d4217b819496140c79a11', 'request_id': 'req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:26.366101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] The token cache is being invalidate because project ceee87ee031d4217b819496140c79a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:06:26.366582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:26.367897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:26.369807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1244/2473] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:06:26 2022] DELETE /identity/v3/projects/ceee87ee031d4217b819496140c79a11 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:27.293566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fbb38-d57b-4baa-a1d9-dd643222aa73 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:27.294141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fbb38-d57b-4baa-a1d9-dd643222aa73 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:27.294409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fbb38-d57b-4baa-a1d9-dd643222aa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:27.317168 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-228fbb38-d57b-4baa-a1d9-dd643222aa73 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:27.318425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-228fbb38-d57b-4baa-a1d9-dd643222aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:27.373373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:27.383992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1230/2474] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 15:06:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:27.397845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:27.399409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:27.486458 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe0b0e-db0d-4f01-96d2-8b8f2a6868ea admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:27.493727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838ca0-d2a0-46fd-b6f6-2ae228600b1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:27.494508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838ca0-d2a0-46fd-b6f6-2ae228600b1e service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:27.494995 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838ca0-d2a0-46fd-b6f6-2ae228600b1e service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:27.495365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838ca0-d2a0-46fd-b6f6-2ae228600b1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:27.509628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9838ca0-d2a0-46fd-b6f6-2ae228600b1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:27.512198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9838ca0-d2a0-46fd-b6f6-2ae228600b1e service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:27.523365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1245/2475] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 15:06:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:06:37.391086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:37.519080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:44.561932 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fbb38-d57b-4baa-a1d9-dd643222aa73 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:44.564528 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-228fbb38-d57b-4baa-a1d9-dd643222aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:44.624048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fbb38-d57b-4baa-a1d9-dd643222aa73 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:44.627832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82d70-4fe5-4517-b253-6306b860c39b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:44.629776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82d70-4fe5-4517-b253-6306b860c39b service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:44.629776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82d70-4fe5-4517-b253-6306b860c39b service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:44.629776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82d70-4fe5-4517-b253-6306b860c39b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:44.634915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e0b82d70-4fe5-4517-b253-6306b860c39b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:44.738385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82d70-4fe5-4517-b253-6306b860c39b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:44.739850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82d70-4fe5-4517-b253-6306b860c39b service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:44.761899 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1231/2476] 10.222.0.81 () {60 vars in 1396 bytes} [Thu Jun 16 15:06:44 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:45.867003 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533b7c-b707-4c72-badc-9fc8b326304e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.867624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533b7c-b707-4c72-badc-9fc8b326304e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.867624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533b7c-b707-4c72-badc-9fc8b326304e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.887341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-bf533b7c-b707-4c72-badc-9fc8b326304e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:45.889394 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bf533b7c-b707-4c72-badc-9fc8b326304e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:45.972825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1246/2477] 10.222.0.90 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:45.997483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82d70-4fe5-4517-b253-6306b860c39b service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:45.999219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e0b82d70-4fe5-4517-b253-6306b860c39b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:46.075159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82d70-4fe5-4517-b253-6306b860c39b service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:46.080916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e258d5-d36a-4230-8b6a-b8c705a972c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:46.081582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e258d5-d36a-4230-8b6a-b8c705a972c9 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:46.081866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e258d5-d36a-4230-8b6a-b8c705a972c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:46.082171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e258d5-d36a-4230-8b6a-b8c705a972c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:46.090956 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e258d5-d36a-4230-8b6a-b8c705a972c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:46.092553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e258d5-d36a-4230-8b6a-b8c705a972c9 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:46.102509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1232/2478] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:53.161031 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603d28b-d18d-4232-93cd-2c32b4dacf47 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:53.161537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603d28b-d18d-4232-93cd-2c32b4dacf47 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:53.161655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603d28b-d18d-4232-93cd-2c32b4dacf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:53.180785 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1603d28b-d18d-4232-93cd-2c32b4dacf47 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:53.181941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1603d28b-d18d-4232-93cd-2c32b4dacf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:53.190181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1247/2479] 10.222.0.90 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:53.220140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e258d5-d36a-4230-8b6a-b8c705a972c9 service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:53.231738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e258d5-d36a-4230-8b6a-b8c705a972c9 service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:53.237576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5fc71-08f8-4d4f-8639-2a594a5e60cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:53.238259 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5fc71-08f8-4d4f-8639-2a594a5e60cd service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:53.238544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5fc71-08f8-4d4f-8639-2a594a5e60cd service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:53.238819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5fc71-08f8-4d4f-8639-2a594a5e60cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:53.247516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5fc71-08f8-4d4f-8639-2a594a5e60cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:53.249134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5fc71-08f8-4d4f-8639-2a594a5e60cd service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:53.253371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:53.261126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1233/2480] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:56.423677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008420e8-f9cb-4775-94b6-f2dc2f345423 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:56.424232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008420e8-f9cb-4775-94b6-f2dc2f345423 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:56.424232 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008420e8-f9cb-4775-94b6-f2dc2f345423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:56.445013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-008420e8-f9cb-4775-94b6-f2dc2f345423 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:56.446283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-008420e8-f9cb-4775-94b6-f2dc2f345423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:56.455631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1248/2481] 10.222.0.81 () {58 vars in 967 bytes} [Thu Jun 16 15:06:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:56.484651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5fc71-08f8-4d4f-8639-2a594a5e60cd service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:56.500434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5fc71-08f8-4d4f-8639-2a594a5e60cd service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:56.506160 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6f08-6a7d-4205-a5da-8383382c12e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:56.507116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6f08-6a7d-4205-a5da-8383382c12e7 service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:56.507358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6f08-6a7d-4205-a5da-8383382c12e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:56.507539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6f08-6a7d-4205-a5da-8383382c12e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:56.522718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed6f08-6a7d-4205-a5da-8383382c12e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:56.524316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed6f08-6a7d-4205-a5da-8383382c12e7 service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:56.534202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1234/2482] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 15:06:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:07:06.439523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=33 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:06.530484 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=7 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:16.351306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c49c93-31b6-4d4e-be1c-d24cb6d7a95d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:16.351885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c49c93-31b6-4d4e-be1c-d24cb6d7a95d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:16.351885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c49c93-31b6-4d4e-be1c-d24cb6d7a95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:16.383996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-24c49c93-31b6-4d4e-be1c-d24cb6d7a95d None None] MFA Rules not processed for user `2eb8e7ee469d426388e4cba3f6830f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:16.385347 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-24c49c93-31b6-4d4e-be1c-d24cb6d7a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:16.474064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1249/2483] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:18.617339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6f08-6a7d-4205-a5da-8383382c12e7 service swift] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:18.619549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2aed6f08-6a7d-4205-a5da-8383382c12e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:18.743944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6f08-6a7d-4205-a5da-8383382c12e7 service swift] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:18.748355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20a481-ecc0-4dab-974c-e16b1297019c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:18.749012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a481-ecc0-4dab-974c-e16b1297019c service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:18.749292 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a481-ecc0-4dab-974c-e16b1297019c service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:18.749623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a481-ecc0-4dab-974c-e16b1297019c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:18.751513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5d20a481-ecc0-4dab-974c-e16b1297019c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:18.799250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20a481-ecc0-4dab-974c-e16b1297019c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:18.801007 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20a481-ecc0-4dab-974c-e16b1297019c service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:18.822489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1235/2484] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:22.428148 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c49c93-31b6-4d4e-be1c-d24cb6d7a95d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:22.429807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-24c49c93-31b6-4d4e-be1c-d24cb6d7a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:22.452200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c49c93-31b6-4d4e-be1c-d24cb6d7a95d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:22.456978 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c3fe7-cd4e-497c-a113-e7f17ea89f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:22.458029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3fe7-cd4e-497c-a113-e7f17ea89f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:22.458316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3fe7-cd4e-497c-a113-e7f17ea89f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:22.458590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3fe7-cd4e-497c-a113-e7f17ea89f51 admin admin] PATH_INFO: `/v3/users/561c947ee70e4521b594f0d528e6e6dd` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:22.459775 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c3fe7-cd4e-497c-a113-e7f17ea89f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=561c947ee70e4521b594f0d528e6e6dd)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:22.461710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c3fe7-cd4e-497c-a113-e7f17ea89f51 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:22.510857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-263c3fe7-cd4e-497c-a113-e7f17ea89f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561c947ee70e4521b594f0d528e6e6dd'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:22.511564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-263c3fe7-cd4e-497c-a113-e7f17ea89f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561c947ee70e4521b594f0d528e6e6dd'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:22.512172 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-263c3fe7-cd4e-497c-a113-e7f17ea89f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561c947ee70e4521b594f0d528e6e6dd'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:22.519050 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-263c3fe7-cd4e-497c-a113-e7f17ea89f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561c947ee70e4521b594f0d528e6e6dd'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:22.527899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-263c3fe7-cd4e-497c-a113-e7f17ea89f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561c947ee70e4521b594f0d528e6e6dd'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:22.546519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1250/2485] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:22 2022] DELETE /identity/v3/users/561c947ee70e4521b594f0d528e6e6dd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:22.730519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20a481-ecc0-4dab-974c-e16b1297019c service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:22.743603 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20a481-ecc0-4dab-974c-e16b1297019c service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:22.811894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:22.812816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:22.813146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:22.813323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] PATH_INFO: `/v3/projects/eb37393acca7490094455e179543e524` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:22.814728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb37393acca7490094455e179543e524)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:22.816669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:22.854417 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:22.870078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb37393acca7490094455e179543e524', 'request_id': 'req-1f412adf-d840-47b0-9012-135873539a1f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:22.878079 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb37393acca7490094455e179543e524', 'request_id': 'req-1f412adf-d840-47b0-9012-135873539a1f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:22.884664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb37393acca7490094455e179543e524', 'request_id': 'req-1f412adf-d840-47b0-9012-135873539a1f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:22.895683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] The token cache is being invalidate because project eb37393acca7490094455e179543e524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:22.895969 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:22.896655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1f412adf-d840-47b0-9012-135873539a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:22.898249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1236/2486] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:22 2022] DELETE /identity/v3/projects/eb37393acca7490094455e179543e524 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:22.904069 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ddcae-1e61-4090-a72c-f006f2de2d19 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:22.904273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ddcae-1e61-4090-a72c-f006f2de2d19 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:22.904554 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ddcae-1e61-4090-a72c-f006f2de2d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:22.967381 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-382ddcae-1e61-4090-a72c-f006f2de2d19 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:22.968508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-382ddcae-1e61-4090-a72c-f006f2de2d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:22.982909 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:23.031924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1251/2487] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:23.039455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364ae1f-76a5-45d5-b692-b33e42eb7366 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.039746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364ae1f-76a5-45d5-b692-b33e42eb7366 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.040026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364ae1f-76a5-45d5-b692-b33e42eb7366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.059253 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-8364ae1f-76a5-45d5-b692-b33e42eb7366 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:23.060482 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-8364ae1f-76a5-45d5-b692-b33e42eb7366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:23.068613 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1237/2488] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:23.073551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ddcae-1e61-4090-a72c-f006f2de2d19 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.085600 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ddcae-1e61-4090-a72c-f006f2de2d19 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.091179 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74670972-6a19-425b-ad2b-07231f057511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.091848 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74670972-6a19-425b-ad2b-07231f057511 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.092126 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74670972-6a19-425b-ad2b-07231f057511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.092399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74670972-6a19-425b-ad2b-07231f057511 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.093117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74670972-6a19-425b-ad2b-07231f057511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:23.093424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74670972-6a19-425b-ad2b-07231f057511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.095040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74670972-6a19-425b-ad2b-07231f057511 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.107254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1252/2489] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:07:23.112523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364ae1f-76a5-45d5-b692-b33e42eb7366 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.121991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364ae1f-76a5-45d5-b692-b33e42eb7366 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.126773 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78ca65-53c0-42d3-af1f-b60267de4086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.127437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78ca65-53c0-42d3-af1f-b60267de4086 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.127717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78ca65-53c0-42d3-af1f-b60267de4086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.127988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78ca65-53c0-42d3-af1f-b60267de4086 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.128671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78ca65-53c0-42d3-af1f-b60267de4086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.130615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78ca65-53c0-42d3-af1f-b60267de4086 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.157485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1238/2490] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:23 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:23.161642 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74670972-6a19-425b-ad2b-07231f057511 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.171499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74670972-6a19-425b-ad2b-07231f057511 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.227174 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b3cfe-b963-4582-850b-b99e41eaf4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.227833 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b3cfe-b963-4582-850b-b99e41eaf4bb admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.228112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b3cfe-b963-4582-850b-b99e41eaf4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.228382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b3cfe-b963-4582-850b-b99e41eaf4bb admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.229071 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b3cfe-b963-4582-850b-b99e41eaf4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.231072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b3cfe-b963-4582-850b-b99e41eaf4bb admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.251599 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1253/2491] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:23 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:07:23.255691 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78ca65-53c0-42d3-af1f-b60267de4086 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.267705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78ca65-53c0-42d3-af1f-b60267de4086 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.272765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1993a-d003-456f-bc68-fd705e84fea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.273646 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1993a-d003-456f-bc68-fd705e84fea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.273906 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1993a-d003-456f-bc68-fd705e84fea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.274190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1993a-d003-456f-bc68-fd705e84fea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.274921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1993a-d003-456f-bc68-fd705e84fea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.277331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1993a-d003-456f-bc68-fd705e84fea2 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.288560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1239/2492] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:23.292786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b3cfe-b963-4582-850b-b99e41eaf4bb admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.303243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b3cfe-b963-4582-850b-b99e41eaf4bb admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.308051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc99a43-90cc-48c5-9d41-a9b04ccb503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.308755 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc99a43-90cc-48c5-9d41-a9b04ccb503f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.309036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc99a43-90cc-48c5-9d41-a9b04ccb503f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.309313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc99a43-90cc-48c5-9d41-a9b04ccb503f admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.310076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc99a43-90cc-48c5-9d41-a9b04ccb503f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.311713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc99a43-90cc-48c5-9d41-a9b04ccb503f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.322943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1254/2493] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:07:23.327826 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1993a-d003-456f-bc68-fd705e84fea2 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.338082 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1993a-d003-456f-bc68-fd705e84fea2 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.344311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271438f7-661c-4687-b903-b9a13a1f1816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.345207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271438f7-661c-4687-b903-b9a13a1f1816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.345490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271438f7-661c-4687-b903-b9a13a1f1816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.345766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271438f7-661c-4687-b903-b9a13a1f1816 admin admin] PATH_INFO: `/v3/projects/fe8f97f6e7f345948940f44aca9701e1/users/96df0789196741d7bbcd7dfe4932c002/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.363450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271438f7-661c-4687-b903-b9a13a1f1816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8f97f6e7f345948940f44aca9701e1, user_id=96df0789196741d7bbcd7dfe4932c002, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.366140 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271438f7-661c-4687-b903-b9a13a1f1816 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.382337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1240/2494] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:23 2022] PUT /identity/v3/projects/fe8f97f6e7f345948940f44aca9701e1/users/96df0789196741d7bbcd7dfe4932c002/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:23.403196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c509e5-6e49-4e3d-ad5d-78289f6978a5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.403467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c509e5-6e49-4e3d-ad5d-78289f6978a5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.403745 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c509e5-6e49-4e3d-ad5d-78289f6978a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.438527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-25c509e5-6e49-4e3d-ad5d-78289f6978a5 None None] MFA Rules not processed for user `96df0789196741d7bbcd7dfe4932c002`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:23.439726 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-25c509e5-6e49-4e3d-ad5d-78289f6978a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:23.506180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1255/2495] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:23.511640 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271438f7-661c-4687-b903-b9a13a1f1816 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.575540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271438f7-661c-4687-b903-b9a13a1f1816 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.580404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbea829-82cb-4f1f-b825-3b901b30496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.581093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbea829-82cb-4f1f-b825-3b901b30496b admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.581377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbea829-82cb-4f1f-b825-3b901b30496b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.581652 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbea829-82cb-4f1f-b825-3b901b30496b admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.582373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbea829-82cb-4f1f-b825-3b901b30496b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.584400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbea829-82cb-4f1f-b825-3b901b30496b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.613650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1241/2496] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:23 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:23.617806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c509e5-6e49-4e3d-ad5d-78289f6978a5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.629725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c509e5-6e49-4e3d-ad5d-78289f6978a5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.642631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:23.695153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98071fbc-6310-4d26-a357-f53a6f997c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.695872 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98071fbc-6310-4d26-a357-f53a6f997c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.696158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98071fbc-6310-4d26-a357-f53a6f997c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.696435 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98071fbc-6310-4d26-a357-f53a6f997c79 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.697137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98071fbc-6310-4d26-a357-f53a6f997c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.700426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98071fbc-6310-4d26-a357-f53a6f997c79 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.723904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1256/2497] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:23 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:23.725086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbea829-82cb-4f1f-b825-3b901b30496b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.735585 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbea829-82cb-4f1f-b825-3b901b30496b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.740394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bba1e-05df-45d0-ad35-fbc281d3c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.741052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bba1e-05df-45d0-ad35-fbc281d3c37b admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.741337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bba1e-05df-45d0-ad35-fbc281d3c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.741614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bba1e-05df-45d0-ad35-fbc281d3c37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.742377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bba1e-05df-45d0-ad35-fbc281d3c37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.743981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bba1e-05df-45d0-ad35-fbc281d3c37b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.755655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1242/2498] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:23.760167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98071fbc-6310-4d26-a357-f53a6f997c79 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.770944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98071fbc-6310-4d26-a357-f53a6f997c79 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.775525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597ebf2-321e-48ca-ac04-0ee7783766b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.776761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ebf2-321e-48ca-ac04-0ee7783766b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.776888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ebf2-321e-48ca-ac04-0ee7783766b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.777121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ebf2-321e-48ca-ac04-0ee7783766b6 admin admin] PATH_INFO: `/v3/projects/29bf916b3e5548d797d0f0ba061806be/users/dce313c4f3fe425f82d64ac62c909ba3/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.793573 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597ebf2-321e-48ca-ac04-0ee7783766b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bf916b3e5548d797d0f0ba061806be, user_id=dce313c4f3fe425f82d64ac62c909ba3, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.796268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597ebf2-321e-48ca-ac04-0ee7783766b6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.809841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1257/2499] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:23 2022] PUT /identity/v3/projects/29bf916b3e5548d797d0f0ba061806be/users/dce313c4f3fe425f82d64ac62c909ba3/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:23.814115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bba1e-05df-45d0-ad35-fbc281d3c37b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.824622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bba1e-05df-45d0-ad35-fbc281d3c37b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.850931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:23.885289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc253f9-9c9c-4470-b7e2-22a4827f83c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.886097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc253f9-9c9c-4470-b7e2-22a4827f83c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.886281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc253f9-9c9c-4470-b7e2-22a4827f83c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.886562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc253f9-9c9c-4470-b7e2-22a4827f83c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.887284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc253f9-9c9c-4470-b7e2-22a4827f83c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.888898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc253f9-9c9c-4470-b7e2-22a4827f83c6 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.904330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1243/2500] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:23.908546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597ebf2-321e-48ca-ac04-0ee7783766b6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:23.919730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597ebf2-321e-48ca-ac04-0ee7783766b6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.924579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a007b1b-1972-4691-b8a4-2d62263786d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.925481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a007b1b-1972-4691-b8a4-2d62263786d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.925763 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a007b1b-1972-4691-b8a4-2d62263786d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.926102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a007b1b-1972-4691-b8a4-2d62263786d9 admin admin] PATH_INFO: `/v3/projects/29bf916b3e5548d797d0f0ba061806be/users/dce313c4f3fe425f82d64ac62c909ba3/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.928119 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a007b1b-1972-4691-b8a4-2d62263786d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bf916b3e5548d797d0f0ba061806be, user_id=dce313c4f3fe425f82d64ac62c909ba3, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.931075 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a007b1b-1972-4691-b8a4-2d62263786d9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.943101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1258/2501] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:23 2022] PUT /identity/v3/projects/29bf916b3e5548d797d0f0ba061806be/users/dce313c4f3fe425f82d64ac62c909ba3/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:23.953614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c296cc-6c9f-408a-80cb-c65f901ebcb1 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.954040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c296cc-6c9f-408a-80cb-c65f901ebcb1 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.954387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c296cc-6c9f-408a-80cb-c65f901ebcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.983312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-65c296cc-6c9f-408a-80cb-c65f901ebcb1 None None] MFA Rules not processed for user `dce313c4f3fe425f82d64ac62c909ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:23.984554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-65c296cc-6c9f-408a-80cb-c65f901ebcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:24.059829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1244/2502] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:24.071416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a007b1b-1972-4691-b8a4-2d62263786d9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:24.073268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7a007b1b-1972-4691-b8a4-2d62263786d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:24.131391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a007b1b-1972-4691-b8a4-2d62263786d9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:24.135308 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35d8d1-092c-4da0-b8e8-a5a002a9a35c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:24.136176 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35d8d1-092c-4da0-b8e8-a5a002a9a35c service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:24.136562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35d8d1-092c-4da0-b8e8-a5a002a9a35c service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:24.136711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35d8d1-092c-4da0-b8e8-a5a002a9a35c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:24.197137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35d8d1-092c-4da0-b8e8-a5a002a9a35c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:24.198640 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35d8d1-092c-4da0-b8e8-a5a002a9a35c service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:24.209005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1259/2503] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:25.615208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c296cc-6c9f-408a-80cb-c65f901ebcb1 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:25.616619 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-65c296cc-6c9f-408a-80cb-c65f901ebcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:25.629710 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c296cc-6c9f-408a-80cb-c65f901ebcb1 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:25.633598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13c2bf-b9e3-40f4-a9cf-957178909143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:25.634287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13c2bf-b9e3-40f4-a9cf-957178909143 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:25.634570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13c2bf-b9e3-40f4-a9cf-957178909143 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:25.634850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13c2bf-b9e3-40f4-a9cf-957178909143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:25.644833 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13c2bf-b9e3-40f4-a9cf-957178909143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:25.646309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13c2bf-b9e3-40f4-a9cf-957178909143 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:25.656244 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1245/2504] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:29.530758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35d8d1-092c-4da0-b8e8-a5a002a9a35c service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:29.557029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:29.597816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35d8d1-092c-4da0-b8e8-a5a002a9a35c service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:29.602418 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:29.603291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:29.603562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:29.603827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] PATH_INFO: `/v3/users/96df0789196741d7bbcd7dfe4932c002` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:29.605282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96df0789196741d7bbcd7dfe4932c002)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:29.607250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:29.662894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96df0789196741d7bbcd7dfe4932c002'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:29.663455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96df0789196741d7bbcd7dfe4932c002'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:29.664082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96df0789196741d7bbcd7dfe4932c002'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:29.671897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96df0789196741d7bbcd7dfe4932c002'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:29.680407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96df0789196741d7bbcd7dfe4932c002'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:29.700671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1260/2505] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:29 2022] DELETE /identity/v3/users/96df0789196741d7bbcd7dfe4932c002 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:29.706456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050b7b-ed54-4e6b-af5a-4e176b8d6169 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:29.707201 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050b7b-ed54-4e6b-af5a-4e176b8d6169 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:29.707388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050b7b-ed54-4e6b-af5a-4e176b8d6169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:29.729004 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3d050b7b-ed54-4e6b-af5a-4e176b8d6169 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:29.730353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3d050b7b-ed54-4e6b-af5a-4e176b8d6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:29.799857 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1246/2506] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:29.810776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:29.812280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:29.873146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e2e95-0ec7-46c0-99da-f44aa3568999 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:29.876875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaa056-1691-4365-9a66-3eb7b34b0659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:29.877527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaa056-1691-4365-9a66-3eb7b34b0659 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:29.877807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaa056-1691-4365-9a66-3eb7b34b0659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:29.878114 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaa056-1691-4365-9a66-3eb7b34b0659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:29.887902 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aaa056-1691-4365-9a66-3eb7b34b0659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:29.889371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aaa056-1691-4365-9a66-3eb7b34b0659 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:29.902919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1261/2507] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:30.194901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d050b7b-ed54-4e6b-af5a-4e176b8d6169 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:30.196468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3d050b7b-ed54-4e6b-af5a-4e176b8d6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:30.211491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d050b7b-ed54-4e6b-af5a-4e176b8d6169 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:30.217042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:30.217963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:30.218248 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:30.219023 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] PATH_INFO: `/v3/projects/fe8f97f6e7f345948940f44aca9701e1` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:30.219800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8f97f6e7f345948940f44aca9701e1)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:30.221836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:30.267912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:30.279070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8f97f6e7f345948940f44aca9701e1', 'request_id': 'req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:30.288207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8f97f6e7f345948940f44aca9701e1', 'request_id': 'req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:30.297828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8f97f6e7f345948940f44aca9701e1', 'request_id': 'req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:30.311050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] The token cache is being invalidate because project fe8f97f6e7f345948940f44aca9701e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:30.311290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:30.311918 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:30.313525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1247/2508] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:30 2022] DELETE /identity/v3/projects/fe8f97f6e7f345948940f44aca9701e1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:30.317732 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaa056-1691-4365-9a66-3eb7b34b0659 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:30.331546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaa056-1691-4365-9a66-3eb7b34b0659 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:30.377390 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:30.395737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e19067-9ee3-4667-a4ad-1adf07d0e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:30.396749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e19067-9ee3-4667-a4ad-1adf07d0e262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:30.397050 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e19067-9ee3-4667-a4ad-1adf07d0e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:30.397373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e19067-9ee3-4667-a4ad-1adf07d0e262 admin admin] PATH_INFO: `/v3/users/dce313c4f3fe425f82d64ac62c909ba3` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:30.398797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e19067-9ee3-4667-a4ad-1adf07d0e262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce313c4f3fe425f82d64ac62c909ba3)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:30.401401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e19067-9ee3-4667-a4ad-1adf07d0e262 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:30.461230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b8e19067-9ee3-4667-a4ad-1adf07d0e262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce313c4f3fe425f82d64ac62c909ba3'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:30.461934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b8e19067-9ee3-4667-a4ad-1adf07d0e262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce313c4f3fe425f82d64ac62c909ba3'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:30.462591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b8e19067-9ee3-4667-a4ad-1adf07d0e262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce313c4f3fe425f82d64ac62c909ba3'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:30.473623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b8e19067-9ee3-4667-a4ad-1adf07d0e262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce313c4f3fe425f82d64ac62c909ba3'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:30.483302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b8e19067-9ee3-4667-a4ad-1adf07d0e262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce313c4f3fe425f82d64ac62c909ba3'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:30.503380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1262/2509] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:30 2022] DELETE /identity/v3/users/dce313c4f3fe425f82d64ac62c909ba3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:30.816803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:30.817257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:30.831746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129f6bc-6d46-4ef4-8ed0-ad2ead90ef32 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:30.906120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:30.906995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:30.907270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:30.907538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] PATH_INFO: `/v3/projects/29bf916b3e5548d797d0f0ba061806be` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:30.908727 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29bf916b3e5548d797d0f0ba061806be)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:30.910853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:30.982470 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29bf916b3e5548d797d0f0ba061806be', 'request_id': 'req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:30.993031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29bf916b3e5548d797d0f0ba061806be', 'request_id': 'req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:31.002189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29bf916b3e5548d797d0f0ba061806be', 'request_id': 'req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:31.015642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] The token cache is being invalidate because project 29bf916b3e5548d797d0f0ba061806be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:31.015935 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:31.016598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-b7b25a5d-71ed-4a5c-96cb-de62cca5f1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:31.018184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1248/2510] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:30 2022] DELETE /identity/v3/projects/29bf916b3e5548d797d0f0ba061806be => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:31.023801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b73ec-9779-4c2b-b2f2-bbf360889e8b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.024295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b73ec-9779-4c2b-b2f2-bbf360889e8b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.024576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b73ec-9779-4c2b-b2f2-bbf360889e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.043903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5d8b73ec-9779-4c2b-b2f2-bbf360889e8b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:31.045130 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5d8b73ec-9779-4c2b-b2f2-bbf360889e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:31.113183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1263/2511] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:31.121784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c4e6e-97de-49b2-a269-03cae03342d9 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.122137 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c4e6e-97de-49b2-a269-03cae03342d9 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.122378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c4e6e-97de-49b2-a269-03cae03342d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.145223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b85c4e6e-97de-49b2-a269-03cae03342d9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:31.146499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b85c4e6e-97de-49b2-a269-03cae03342d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:31.154866 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1249/2512] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:31.160518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b73ec-9779-4c2b-b2f2-bbf360889e8b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:31.171838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b73ec-9779-4c2b-b2f2-bbf360889e8b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:31.176498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b084afb-b33e-4640-b125-fb19f765606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:31.177160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084afb-b33e-4640-b125-fb19f765606f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.177443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084afb-b33e-4640-b125-fb19f765606f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.177715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084afb-b33e-4640-b125-fb19f765606f admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.178483 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b084afb-b33e-4640-b125-fb19f765606f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:31.178786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b084afb-b33e-4640-b125-fb19f765606f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:31.180375 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b084afb-b33e-4640-b125-fb19f765606f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:31.193831 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1264/2513] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:07:31.199901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c4e6e-97de-49b2-a269-03cae03342d9 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:31.209535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c4e6e-97de-49b2-a269-03cae03342d9 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:31.214562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0021f-9449-4310-bc47-7beb976621cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:31.215235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0021f-9449-4310-bc47-7beb976621cf admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.215527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0021f-9449-4310-bc47-7beb976621cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.215803 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0021f-9449-4310-bc47-7beb976621cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.216761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0021f-9449-4310-bc47-7beb976621cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:31.218725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0021f-9449-4310-bc47-7beb976621cf admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:31.247682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1250/2514] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:31 2022] POST /identity/v3/projects => generated 409 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:31.252219 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b084afb-b33e-4640-b125-fb19f765606f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:31.263538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b084afb-b33e-4640-b125-fb19f765606f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:31.322007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:31.333779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b37486-d897-4cee-8c93-caecc08bc62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:31.334496 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b37486-d897-4cee-8c93-caecc08bc62a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.334953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b37486-d897-4cee-8c93-caecc08bc62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.335300 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b37486-d897-4cee-8c93-caecc08bc62a admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.335960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b37486-d897-4cee-8c93-caecc08bc62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:31.338189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b37486-d897-4cee-8c93-caecc08bc62a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:31.362720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1265/2515] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:31 2022] POST /identity/v3/users => generated 305 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:31.364037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0021f-9449-4310-bc47-7beb976621cf admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:31.375128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0021f-9449-4310-bc47-7beb976621cf admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:31.379962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763efd6-0faa-4965-9f33-b0619a8be9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:31.380637 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763efd6-0faa-4965-9f33-b0619a8be9fc admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.380923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763efd6-0faa-4965-9f33-b0619a8be9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.381202 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763efd6-0faa-4965-9f33-b0619a8be9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.381968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763efd6-0faa-4965-9f33-b0619a8be9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:31.383833 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763efd6-0faa-4965-9f33-b0619a8be9fc admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:31.394925 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1251/2516] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:31.398954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b37486-d897-4cee-8c93-caecc08bc62a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:31.409103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b37486-d897-4cee-8c93-caecc08bc62a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:31.414421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a0be7-5689-41b8-9476-5c6f55499a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:31.415109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0be7-5689-41b8-9476-5c6f55499a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.415391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0be7-5689-41b8-9476-5c6f55499a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.415662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0be7-5689-41b8-9476-5c6f55499a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.416380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a0be7-5689-41b8-9476-5c6f55499a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:31.418658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a0be7-5689-41b8-9476-5c6f55499a3d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:31.430609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1266/2517] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:31.435902 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763efd6-0faa-4965-9f33-b0619a8be9fc admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:31.450649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763efd6-0faa-4965-9f33-b0619a8be9fc admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:31.455437 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88171-1117-45ee-8db3-9c3339d4cdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:31.456334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88171-1117-45ee-8db3-9c3339d4cdca admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.456619 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88171-1117-45ee-8db3-9c3339d4cdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.456908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88171-1117-45ee-8db3-9c3339d4cdca admin admin] PATH_INFO: `/v3/projects/4bf906ab26384c0aabed50b9bd867f0d/users/2be1898906cd41f9b88d40bd7833feaf/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.465954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:31.475653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a88171-1117-45ee-8db3-9c3339d4cdca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf906ab26384c0aabed50b9bd867f0d, user_id=2be1898906cd41f9b88d40bd7833feaf, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:31.478590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a88171-1117-45ee-8db3-9c3339d4cdca admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:31.495448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1252/2518] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:31 2022] PUT /identity/v3/projects/4bf906ab26384c0aabed50b9bd867f0d/users/2be1898906cd41f9b88d40bd7833feaf/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:07:31.506919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bea11-b0f8-4b79-a2f1-f090bc7adcd3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.507208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bea11-b0f8-4b79-a2f1-f090bc7adcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.507483 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bea11-b0f8-4b79-a2f1-f090bc7adcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.537970 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-553bea11-b0f8-4b79-a2f1-f090bc7adcd3 None None] MFA Rules not processed for user `2be1898906cd41f9b88d40bd7833feaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:31.539195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-553bea11-b0f8-4b79-a2f1-f090bc7adcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:31.614795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1267/2519] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:31.618838 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88171-1117-45ee-8db3-9c3339d4cdca admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:31.699894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88171-1117-45ee-8db3-9c3339d4cdca admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:31.705371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8d29-e973-41a6-8ded-620d7f898bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:31.706206 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8d29-e973-41a6-8ded-620d7f898bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.706495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8d29-e973-41a6-8ded-620d7f898bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.706769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8d29-e973-41a6-8ded-620d7f898bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.707471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e8d29-e973-41a6-8ded-620d7f898bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:31.709382 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e8d29-e973-41a6-8ded-620d7f898bbc admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:31.746381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1253/2520] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:31 2022] POST /identity/v3/projects => generated 407 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:31.750655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bea11-b0f8-4b79-a2f1-f090bc7adcd3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:31.762727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bea11-b0f8-4b79-a2f1-f090bc7adcd3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:31.836312 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d4ebb-7deb-468d-b2df-0aad601deae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:31.837098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d4ebb-7deb-468d-b2df-0aad601deae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.837383 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d4ebb-7deb-468d-b2df-0aad601deae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.837657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d4ebb-7deb-468d-b2df-0aad601deae6 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.839091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d4ebb-7deb-468d-b2df-0aad601deae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:31.841071 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d4ebb-7deb-468d-b2df-0aad601deae6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:31.866015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1268/2521] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:31 2022] POST /identity/v3/users => generated 310 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:31.868746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8d29-e973-41a6-8ded-620d7f898bbc admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:31.882642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8d29-e973-41a6-8ded-620d7f898bbc admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:31.889056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0523e-e4d5-497d-90a5-1d714a750211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:31.889732 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0523e-e4d5-497d-90a5-1d714a750211 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.890050 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0523e-e4d5-497d-90a5-1d714a750211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.890323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0523e-e4d5-497d-90a5-1d714a750211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.891060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0523e-e4d5-497d-90a5-1d714a750211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:31.892800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0523e-e4d5-497d-90a5-1d714a750211 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:31.905495 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1254/2522] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:07:31.911012 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d4ebb-7deb-468d-b2df-0aad601deae6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:31.922458 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d4ebb-7deb-468d-b2df-0aad601deae6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:31.927478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745db804-1c65-4442-99c4-8444e2b25d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:31.928233 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745db804-1c65-4442-99c4-8444e2b25d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:31.928515 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745db804-1c65-4442-99c4-8444e2b25d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:31.928784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745db804-1c65-4442-99c4-8444e2b25d23 admin admin] PATH_INFO: `/v3/projects/597d2009eee44a6b97a8a126f56350fe/users/2b223dc2d60a4a9f98a31908341e7d6c/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:31.949835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745db804-1c65-4442-99c4-8444e2b25d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=597d2009eee44a6b97a8a126f56350fe, user_id=2b223dc2d60a4a9f98a31908341e7d6c, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:31.953871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745db804-1c65-4442-99c4-8444e2b25d23 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:31.976310 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1269/2523] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:31 2022] PUT /identity/v3/projects/597d2009eee44a6b97a8a126f56350fe/users/2b223dc2d60a4a9f98a31908341e7d6c/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:31.981256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0523e-e4d5-497d-90a5-1d714a750211 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:31.993024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0523e-e4d5-497d-90a5-1d714a750211 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:32.070086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f416b-3300-4a6a-8960-99a6bbd45154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:32.070761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f416b-3300-4a6a-8960-99a6bbd45154 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:32.071039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f416b-3300-4a6a-8960-99a6bbd45154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:32.071318 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f416b-3300-4a6a-8960-99a6bbd45154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:32.072038 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f416b-3300-4a6a-8960-99a6bbd45154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:32.074493 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f416b-3300-4a6a-8960-99a6bbd45154 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:32.085299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1255/2524] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:07:32.090788 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745db804-1c65-4442-99c4-8444e2b25d23 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:32.105980 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745db804-1c65-4442-99c4-8444e2b25d23 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:32.117280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ba421-401d-4e3e-af65-9bf5b043fa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:32.118697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba421-401d-4e3e-af65-9bf5b043fa17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:32.119172 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba421-401d-4e3e-af65-9bf5b043fa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:32.119670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba421-401d-4e3e-af65-9bf5b043fa17 admin admin] PATH_INFO: `/v3/projects/597d2009eee44a6b97a8a126f56350fe/users/2b223dc2d60a4a9f98a31908341e7d6c/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:32.123049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ba421-401d-4e3e-af65-9bf5b043fa17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=597d2009eee44a6b97a8a126f56350fe, user_id=2b223dc2d60a4a9f98a31908341e7d6c, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:32.127973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ba421-401d-4e3e-af65-9bf5b043fa17 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:32.146314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1270/2525] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:32 2022] PUT /identity/v3/projects/597d2009eee44a6b97a8a126f56350fe/users/2b223dc2d60a4a9f98a31908341e7d6c/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:07:32.158343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168fad6-c17a-4f0f-b396-d6b52dab3fd4 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:32.158617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168fad6-c17a-4f0f-b396-d6b52dab3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:32.159027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168fad6-c17a-4f0f-b396-d6b52dab3fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:32.195177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-3168fad6-c17a-4f0f-b396-d6b52dab3fd4 None None] MFA Rules not processed for user `2b223dc2d60a4a9f98a31908341e7d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:32.196401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3168fad6-c17a-4f0f-b396-d6b52dab3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:32.247738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:32.274659 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1256/2526] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:32.286314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ba421-401d-4e3e-af65-9bf5b043fa17 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:32.288058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-166ba421-401d-4e3e-af65-9bf5b043fa17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:32.304237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:32.354255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ba421-401d-4e3e-af65-9bf5b043fa17 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:32.358375 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317f407-fafe-4d6e-ab8c-7d063eb447d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:32.359034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317f407-fafe-4d6e-ab8c-7d063eb447d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:32.359439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317f407-fafe-4d6e-ab8c-7d063eb447d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:32.359713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317f407-fafe-4d6e-ab8c-7d063eb447d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:32.369805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317f407-fafe-4d6e-ab8c-7d063eb447d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:32.371707 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317f407-fafe-4d6e-ab8c-7d063eb447d6 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:32.382569 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1271/2527] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:32 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:32.538506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168fad6-c17a-4f0f-b396-d6b52dab3fd4 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:32.548570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168fad6-c17a-4f0f-b396-d6b52dab3fd4 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:32.552228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1a5f0-527f-4b56-8c74-557440070012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:32.552908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1a5f0-527f-4b56-8c74-557440070012 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:32.553183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1a5f0-527f-4b56-8c74-557440070012 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:32.553455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1a5f0-527f-4b56-8c74-557440070012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:32.628067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1a5f0-527f-4b56-8c74-557440070012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:32.629427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1a5f0-527f-4b56-8c74-557440070012 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:32.640514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1257/2528] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:34.664207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d8c5-05cd-40fb-89a3-1097305d16a9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.664637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d8c5-05cd-40fb-89a3-1097305d16a9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.664637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d8c5-05cd-40fb-89a3-1097305d16a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.683636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1ea4d8c5-05cd-40fb-89a3-1097305d16a9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:34.684838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1ea4d8c5-05cd-40fb-89a3-1097305d16a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:34.748283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1272/2529] 10.222.0.90 () {58 vars in 1016 bytes} [Thu Jun 16 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:34.778882 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1a5f0-527f-4b56-8c74-557440070012 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:34.780456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-11b1a5f0-527f-4b56-8c74-557440070012 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:34.864055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1a5f0-527f-4b56-8c74-557440070012 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:34.869637 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6d460-f3f3-4441-af96-29a2ed9f398f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:34.870966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6d460-f3f3-4441-af96-29a2ed9f398f service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.871290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6d460-f3f3-4441-af96-29a2ed9f398f service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.871747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6d460-f3f3-4441-af96-29a2ed9f398f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.889627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6d460-f3f3-4441-af96-29a2ed9f398f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:34.891561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6d460-f3f3-4441-af96-29a2ed9f398f service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:34.902614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1258/2530] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:38.024628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4d8c5-05cd-40fb-89a3-1097305d16a9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:38.035228 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4d8c5-05cd-40fb-89a3-1097305d16a9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:38.039880 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:38.040783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:38.041062 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:38.041339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] PATH_INFO: `/v3/users/2be1898906cd41f9b88d40bd7833feaf` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:38.043188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be1898906cd41f9b88d40bd7833feaf)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:38.045094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:38.098249 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be1898906cd41f9b88d40bd7833feaf'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.098901 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be1898906cd41f9b88d40bd7833feaf'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.099529 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be1898906cd41f9b88d40bd7833feaf'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.106961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be1898906cd41f9b88d40bd7833feaf'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.114326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be1898906cd41f9b88d40bd7833feaf'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.133309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1273/2531] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:38 2022] DELETE /identity/v3/users/2be1898906cd41f9b88d40bd7833feaf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:38.139043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15450f4-c948-4471-b8b1-8837e5d4bcb9 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:38.139611 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15450f4-c948-4471-b8b1-8837e5d4bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:38.139611 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15450f4-c948-4471-b8b1-8837e5d4bcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:38.157563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a15450f4-c948-4471-b8b1-8837e5d4bcb9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:38.158880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a15450f4-c948-4471-b8b1-8837e5d4bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:38.221795 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1259/2532] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:38.231839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:38.233389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:38.266193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:38.298264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb4f15-975a-43f0-b1fc-a587faa8c887 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:38.301863 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86536d-de85-49b7-add8-188a15b27a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:38.302532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86536d-de85-49b7-add8-188a15b27a5a service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:38.302809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86536d-de85-49b7-add8-188a15b27a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:38.303080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86536d-de85-49b7-add8-188a15b27a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:38.317915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86536d-de85-49b7-add8-188a15b27a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:38.319478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86536d-de85-49b7-add8-188a15b27a5a service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:38.330966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1274/2533] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:38.607023 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15450f4-c948-4471-b8b1-8837e5d4bcb9 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:38.608626 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a15450f4-c948-4471-b8b1-8837e5d4bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:38.625094 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15450f4-c948-4471-b8b1-8837e5d4bcb9 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:38.641868 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:38.642793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:38.643056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:38.643338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] PATH_INFO: `/v3/projects/4bf906ab26384c0aabed50b9bd867f0d` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:38.644840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf906ab26384c0aabed50b9bd867f0d)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:38.646873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:38.648847 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:38.727365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf906ab26384c0aabed50b9bd867f0d', 'request_id': 'req-5af716bb-1772-4123-92bd-37a486714088'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.735946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf906ab26384c0aabed50b9bd867f0d', 'request_id': 'req-5af716bb-1772-4123-92bd-37a486714088'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.743971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf906ab26384c0aabed50b9bd867f0d', 'request_id': 'req-5af716bb-1772-4123-92bd-37a486714088'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.758954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] The token cache is being invalidate because project 4bf906ab26384c0aabed50b9bd867f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:38.759300 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.759887 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5af716bb-1772-4123-92bd-37a486714088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.762343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1260/2534] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:38 2022] DELETE /identity/v3/projects/4bf906ab26384c0aabed50b9bd867f0d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:38.768486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86536d-de85-49b7-add8-188a15b27a5a service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:38.780931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86536d-de85-49b7-add8-188a15b27a5a service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:38.867164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:38.868054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:38.868335 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:38.868657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] PATH_INFO: `/v3/users/2b223dc2d60a4a9f98a31908341e7d6c` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:38.871267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b223dc2d60a4a9f98a31908341e7d6c)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:38.874683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:38.932067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b223dc2d60a4a9f98a31908341e7d6c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.933715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b223dc2d60a4a9f98a31908341e7d6c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.935801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b223dc2d60a4a9f98a31908341e7d6c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.943913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b223dc2d60a4a9f98a31908341e7d6c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.954302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b223dc2d60a4a9f98a31908341e7d6c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:38.976849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1275/2535] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:38 2022] DELETE /identity/v3/users/2b223dc2d60a4a9f98a31908341e7d6c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:39.024236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999003f-0ec5-43bd-a53d-7620e5c4710a None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.024529 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999003f-0ec5-43bd-a53d-7620e5c4710a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.025208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999003f-0ec5-43bd-a53d-7620e5c4710a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:39.049581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-f999003f-0ec5-43bd-a53d-7620e5c4710a None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:39.051185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f999003f-0ec5-43bd-a53d-7620e5c4710a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:39.134562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1261/2536] 10.222.0.90 () {58 vars in 1016 bytes} [Thu Jun 16 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:07:39.170157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:39.179336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:39.258281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:39.294294 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5c27-70ff-4f06-a586-26f284bf2d87 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:39.303690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10622bc2-5921-45d0-a990-40f89a3d9811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:39.304365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10622bc2-5921-45d0-a990-40f89a3d9811 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.304663 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10622bc2-5921-45d0-a990-40f89a3d9811 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.304934 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10622bc2-5921-45d0-a990-40f89a3d9811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:39.316479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10622bc2-5921-45d0-a990-40f89a3d9811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:39.318318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10622bc2-5921-45d0-a990-40f89a3d9811 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:39.337210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1276/2537] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:39.349033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999003f-0ec5-43bd-a53d-7620e5c4710a None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:39.351783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f999003f-0ec5-43bd-a53d-7620e5c4710a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:39.366281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999003f-0ec5-43bd-a53d-7620e5c4710a None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:39.372270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:39.373056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.373330 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.373794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] PATH_INFO: `/v3/projects/597d2009eee44a6b97a8a126f56350fe` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:39.375648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=597d2009eee44a6b97a8a126f56350fe)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:39.378174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:39.437286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597d2009eee44a6b97a8a126f56350fe', 'request_id': 'req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:39.446620 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597d2009eee44a6b97a8a126f56350fe', 'request_id': 'req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:39.458537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597d2009eee44a6b97a8a126f56350fe', 'request_id': 'req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:39.476044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] The token cache is being invalidate because project 597d2009eee44a6b97a8a126f56350fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:39.476371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:39.477035 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-916e0a5d-3de4-42b1-91e2-ab6f4b9811e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:39.481132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1262/2538] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:39 2022] DELETE /identity/v3/projects/597d2009eee44a6b97a8a126f56350fe => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:39.486044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272acc68-19cd-4416-94d8-af48e562d028 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.486326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272acc68-19cd-4416-94d8-af48e562d028 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.486597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272acc68-19cd-4416-94d8-af48e562d028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:39.508222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-272acc68-19cd-4416-94d8-af48e562d028 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:39.509456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-272acc68-19cd-4416-94d8-af48e562d028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:39.588115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1277/2539] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:39.598088 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17115b44-4347-46bf-8321-8cff80e98ae1 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.598385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17115b44-4347-46bf-8321-8cff80e98ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.598663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17115b44-4347-46bf-8321-8cff80e98ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:39.618641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-17115b44-4347-46bf-8321-8cff80e98ae1 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:39.619882 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-17115b44-4347-46bf-8321-8cff80e98ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:39.628143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1263/2540] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:39.633099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272acc68-19cd-4416-94d8-af48e562d028 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:39.644377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272acc68-19cd-4416-94d8-af48e562d028 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:39.649197 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2373022-b939-4cc9-ba7a-c713045370be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:39.649866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2373022-b939-4cc9-ba7a-c713045370be admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.650168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2373022-b939-4cc9-ba7a-c713045370be admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.650440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2373022-b939-4cc9-ba7a-c713045370be admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:39.651830 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2373022-b939-4cc9-ba7a-c713045370be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:39.652137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2373022-b939-4cc9-ba7a-c713045370be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:39.653752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2373022-b939-4cc9-ba7a-c713045370be admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:39.668824 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1278/2541] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:07:39.671172 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17115b44-4347-46bf-8321-8cff80e98ae1 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:39.681606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17115b44-4347-46bf-8321-8cff80e98ae1 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:39.686716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a6551-3b79-4f33-8427-be6b7b6b3fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:39.687460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6551-3b79-4f33-8427-be6b7b6b3fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.687675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6551-3b79-4f33-8427-be6b7b6b3fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.687957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6551-3b79-4f33-8427-be6b7b6b3fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:39.688655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a6551-3b79-4f33-8427-be6b7b6b3fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:39.690598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a6551-3b79-4f33-8427-be6b7b6b3fbc admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:39.694048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:39.720818 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1264/2542] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:39 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:39.724841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2373022-b939-4cc9-ba7a-c713045370be admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:39.735913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2373022-b939-4cc9-ba7a-c713045370be admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:39.795747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355be2c-cce2-4798-809f-cc92f981b7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:39.796721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355be2c-cce2-4798-809f-cc92f981b7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.797002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355be2c-cce2-4798-809f-cc92f981b7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.797274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355be2c-cce2-4798-809f-cc92f981b7e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:39.798195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355be2c-cce2-4798-809f-cc92f981b7e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:39.799895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355be2c-cce2-4798-809f-cc92f981b7e5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:39.820255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1279/2543] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:39 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:39.824970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a6551-3b79-4f33-8427-be6b7b6b3fbc admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:39.835994 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a6551-3b79-4f33-8427-be6b7b6b3fbc admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:39.841979 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756ef6a-19f1-4b39-b8ea-86cdb21f6671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:39.842670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756ef6a-19f1-4b39-b8ea-86cdb21f6671 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.843054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756ef6a-19f1-4b39-b8ea-86cdb21f6671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.843356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756ef6a-19f1-4b39-b8ea-86cdb21f6671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:39.844120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756ef6a-19f1-4b39-b8ea-86cdb21f6671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:39.845734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756ef6a-19f1-4b39-b8ea-86cdb21f6671 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:39.860797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1265/2544] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:39.864912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355be2c-cce2-4798-809f-cc92f981b7e5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:39.875376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355be2c-cce2-4798-809f-cc92f981b7e5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:39.880120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed91b21-db17-45a8-88a1-f3126566f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:39.880780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91b21-db17-45a8-88a1-f3126566f2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.881059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91b21-db17-45a8-88a1-f3126566f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.881328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91b21-db17-45a8-88a1-f3126566f2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:39.882073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed91b21-db17-45a8-88a1-f3126566f2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:39.883948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed91b21-db17-45a8-88a1-f3126566f2c8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:39.896506 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1280/2545] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:39.902523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756ef6a-19f1-4b39-b8ea-86cdb21f6671 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:39.913541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756ef6a-19f1-4b39-b8ea-86cdb21f6671 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:39.918584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897800-7e57-4cf3-ba48-81366fbd507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:39.919486 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897800-7e57-4cf3-ba48-81366fbd507d admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.919798 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897800-7e57-4cf3-ba48-81366fbd507d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.920053 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897800-7e57-4cf3-ba48-81366fbd507d admin admin] PATH_INFO: `/v3/projects/2fd908afd4ad49088d0081483e284829/users/956584ff9dad4f8a88ad702feb606411/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:39.936894 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2897800-7e57-4cf3-ba48-81366fbd507d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd908afd4ad49088d0081483e284829, user_id=956584ff9dad4f8a88ad702feb606411, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:39.939974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2897800-7e57-4cf3-ba48-81366fbd507d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:39.954348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1266/2546] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:39 2022] PUT /identity/v3/projects/2fd908afd4ad49088d0081483e284829/users/956584ff9dad4f8a88ad702feb606411/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:39.966037 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530deb7-cd8e-44e5-aa06-b495735eb5a6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:39.966338 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530deb7-cd8e-44e5-aa06-b495735eb5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:39.966595 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530deb7-cd8e-44e5-aa06-b495735eb5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:40.002088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e530deb7-cd8e-44e5-aa06-b495735eb5a6 None None] MFA Rules not processed for user `956584ff9dad4f8a88ad702feb606411`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:40.003327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e530deb7-cd8e-44e5-aa06-b495735eb5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:40.034888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:40.086187 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1281/2547] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:40.098885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897800-7e57-4cf3-ba48-81366fbd507d admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:40.101561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b2897800-7e57-4cf3-ba48-81366fbd507d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:40.178919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897800-7e57-4cf3-ba48-81366fbd507d admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:40.183304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75699c18-71a5-4f85-8202-2fad3f3847eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:40.183963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699c18-71a5-4f85-8202-2fad3f3847eb service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:40.184247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699c18-71a5-4f85-8202-2fad3f3847eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:40.184539 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699c18-71a5-4f85-8202-2fad3f3847eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:40.196112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75699c18-71a5-4f85-8202-2fad3f3847eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:40.197471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75699c18-71a5-4f85-8202-2fad3f3847eb service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:40.207360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1267/2548] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:40.226389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530deb7-cd8e-44e5-aa06-b495735eb5a6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:40.290101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530deb7-cd8e-44e5-aa06-b495735eb5a6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:40.296719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:40.297594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:40.297874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:40.298181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] PATH_INFO: `/v3/users/956584ff9dad4f8a88ad702feb606411` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:40.299385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956584ff9dad4f8a88ad702feb606411)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:40.301295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:40.352007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956584ff9dad4f8a88ad702feb606411'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:40.352667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956584ff9dad4f8a88ad702feb606411'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:40.353264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956584ff9dad4f8a88ad702feb606411'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:40.360657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956584ff9dad4f8a88ad702feb606411'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:40.367388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956584ff9dad4f8a88ad702feb606411'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:40.389621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1282/2549] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:40 2022] DELETE /identity/v3/users/956584ff9dad4f8a88ad702feb606411 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:40.394355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f35aa-a7eb-4b72-aa8f-caf784cde4ed None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:40.394832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f35aa-a7eb-4b72-aa8f-caf784cde4ed None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:40.394929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f35aa-a7eb-4b72-aa8f-caf784cde4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:40.413839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5a1f35aa-a7eb-4b72-aa8f-caf784cde4ed None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:40.415132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5a1f35aa-a7eb-4b72-aa8f-caf784cde4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:40.480692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1268/2550] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:40.490792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:40.492213 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:40.548784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:40.552866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1c539-e2e4-46f1-93e5-89b19b782f60 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:40.558836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc95e4-0d5e-4ede-898c-f7bf1e36cebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:40.559579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc95e4-0d5e-4ede-898c-f7bf1e36cebd service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:40.559902 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc95e4-0d5e-4ede-898c-f7bf1e36cebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:40.560530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc95e4-0d5e-4ede-898c-f7bf1e36cebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:40.570745 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc95e4-0d5e-4ede-898c-f7bf1e36cebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:40.571936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc95e4-0d5e-4ede-898c-f7bf1e36cebd service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:40.582144 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1283/2551] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:40.874658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f35aa-a7eb-4b72-aa8f-caf784cde4ed None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:40.876639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5a1f35aa-a7eb-4b72-aa8f-caf784cde4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:40.893756 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f35aa-a7eb-4b72-aa8f-caf784cde4ed None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:40.896516 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:40.897402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:40.898084 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:40.898366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] PATH_INFO: `/v3/projects/2fd908afd4ad49088d0081483e284829` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:40.899672 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd908afd4ad49088d0081483e284829)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:40.902583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:40.945235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:40.954871 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd908afd4ad49088d0081483e284829', 'request_id': 'req-853553d4-e082-492e-9334-c6b93cfe2cf2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:40.962441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd908afd4ad49088d0081483e284829', 'request_id': 'req-853553d4-e082-492e-9334-c6b93cfe2cf2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:40.970331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd908afd4ad49088d0081483e284829', 'request_id': 'req-853553d4-e082-492e-9334-c6b93cfe2cf2'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:40.982915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] The token cache is being invalidate because project 2fd908afd4ad49088d0081483e284829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:40.983143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:40.983820 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-853553d4-e082-492e-9334-c6b93cfe2cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:40.985449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1269/2552] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:40 2022] DELETE /identity/v3/projects/2fd908afd4ad49088d0081483e284829 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:07:40.990944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53042f-0f66-48c1-9780-7f4591a9bf82 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:40.991498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53042f-0f66-48c1-9780-7f4591a9bf82 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:40.991927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53042f-0f66-48c1-9780-7f4591a9bf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.012762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ab53042f-0f66-48c1-9780-7f4591a9bf82 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:41.014199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ab53042f-0f66-48c1-9780-7f4591a9bf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:41.080878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1284/2553] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:07:41.089462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c688-e49d-47f9-9e06-7af9009fcf26 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.089752 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c688-e49d-47f9-9e06-7af9009fcf26 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.090063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c688-e49d-47f9-9e06-7af9009fcf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.108892 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-f1a9c688-e49d-47f9-9e06-7af9009fcf26 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:41.110149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f1a9c688-e49d-47f9-9e06-7af9009fcf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:41.118309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1270/2554] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:41.122772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53042f-0f66-48c1-9780-7f4591a9bf82 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:41.132526 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53042f-0f66-48c1-9780-7f4591a9bf82 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:41.139516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebd046-c90c-4963-92fd-93afc536d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:41.140747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd046-c90c-4963-92fd-93afc536d4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.141243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd046-c90c-4963-92fd-93afc536d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.141598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd046-c90c-4963-92fd-93afc536d4b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.142472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebd046-c90c-4963-92fd-93afc536d4b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:41.142790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebd046-c90c-4963-92fd-93afc536d4b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:41.144541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebd046-c90c-4963-92fd-93afc536d4b5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:41.157838 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1285/2555] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:07:41.162252 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9c688-e49d-47f9-9e06-7af9009fcf26 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:41.171977 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9c688-e49d-47f9-9e06-7af9009fcf26 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:41.176742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfcee9-1c00-4dc2-b437-7c071b926367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:41.177404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfcee9-1c00-4dc2-b437-7c071b926367 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.177852 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfcee9-1c00-4dc2-b437-7c071b926367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.178255 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfcee9-1c00-4dc2-b437-7c071b926367 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.178909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfcee9-1c00-4dc2-b437-7c071b926367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:41.181106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfcee9-1c00-4dc2-b437-7c071b926367 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:41.211920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1271/2556] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:41 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:41.217657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebd046-c90c-4963-92fd-93afc536d4b5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:41.228101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebd046-c90c-4963-92fd-93afc536d4b5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:41.290607 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f36996-5e85-40ba-8d45-20b2016916d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:41.291195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36996-5e85-40ba-8d45-20b2016916d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.291534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36996-5e85-40ba-8d45-20b2016916d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.291932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36996-5e85-40ba-8d45-20b2016916d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.292675 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f36996-5e85-40ba-8d45-20b2016916d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:41.294643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f36996-5e85-40ba-8d45-20b2016916d4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:41.319196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1286/2557] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:41 2022] POST /identity/v3/users => generated 280 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:41.320742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfcee9-1c00-4dc2-b437-7c071b926367 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:41.333399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfcee9-1c00-4dc2-b437-7c071b926367 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:41.340103 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c3c1-a1f1-4b5a-a329-ce64d09d4c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:41.340794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c3c1-a1f1-4b5a-a329-ce64d09d4c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.341077 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c3c1-a1f1-4b5a-a329-ce64d09d4c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.341364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c3c1-a1f1-4b5a-a329-ce64d09d4c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.342128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069c3c1-a1f1-4b5a-a329-ce64d09d4c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:41.343768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069c3c1-a1f1-4b5a-a329-ce64d09d4c65 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:41.356949 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1272/2558] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:41.362107 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f36996-5e85-40ba-8d45-20b2016916d4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:41.378697 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f36996-5e85-40ba-8d45-20b2016916d4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:41.383618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cddb38-0ab0-4884-aee4-a615e49feca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:41.384288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddb38-0ab0-4884-aee4-a615e49feca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.384576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddb38-0ab0-4884-aee4-a615e49feca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.384851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddb38-0ab0-4884-aee4-a615e49feca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.386296 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cddb38-0ab0-4884-aee4-a615e49feca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:41.388025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cddb38-0ab0-4884-aee4-a615e49feca0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:41.398655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1287/2559] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:41.405136 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c3c1-a1f1-4b5a-a329-ce64d09d4c65 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:41.416696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c3c1-a1f1-4b5a-a329-ce64d09d4c65 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:41.422172 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbc36a-9a76-40b7-8076-5a61c78f8a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:41.423073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc36a-9a76-40b7-8076-5a61c78f8a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.423357 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc36a-9a76-40b7-8076-5a61c78f8a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.423633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc36a-9a76-40b7-8076-5a61c78f8a4c admin admin] PATH_INFO: `/v3/projects/1060c66257694343a1a7a9eca7fee6b7/users/e80507dc56354aefb2ce74799196e88d/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.441468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbc36a-9a76-40b7-8076-5a61c78f8a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1060c66257694343a1a7a9eca7fee6b7, user_id=e80507dc56354aefb2ce74799196e88d, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:41.444331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbc36a-9a76-40b7-8076-5a61c78f8a4c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:41.459218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1273/2560] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:41 2022] PUT /identity/v3/projects/1060c66257694343a1a7a9eca7fee6b7/users/e80507dc56354aefb2ce74799196e88d/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:41.471500 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dd6cc-63ee-471c-af24-cc72509dc516 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.471829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dd6cc-63ee-471c-af24-cc72509dc516 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.472162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dd6cc-63ee-471c-af24-cc72509dc516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.508671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-aa4dd6cc-63ee-471c-af24-cc72509dc516 None None] MFA Rules not processed for user `e80507dc56354aefb2ce74799196e88d`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:41.510944 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-aa4dd6cc-63ee-471c-af24-cc72509dc516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:41.562440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:41.583961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1288/2561] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:41.616936 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbc36a-9a76-40b7-8076-5a61c78f8a4c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:41.618762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d6bbc36a-9a76-40b7-8076-5a61c78f8a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:41.683896 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbc36a-9a76-40b7-8076-5a61c78f8a4c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:41.687767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b922f-be4f-4179-acd3-d1984b7125bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:41.688432 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b922f-be4f-4179-acd3-d1984b7125bc service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.688717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b922f-be4f-4179-acd3-d1984b7125bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.688995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b922f-be4f-4179-acd3-d1984b7125bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.698463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b922f-be4f-4179-acd3-d1984b7125bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:41.699905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b922f-be4f-4179-acd3-d1984b7125bc service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:41.712898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1274/2562] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:41 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:41.735227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dd6cc-63ee-471c-af24-cc72509dc516 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:41.801365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dd6cc-63ee-471c-af24-cc72509dc516 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:41.806214 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:41.807129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.807398 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.807670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] PATH_INFO: `/v3/users/e80507dc56354aefb2ce74799196e88d` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.809168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80507dc56354aefb2ce74799196e88d)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:41.811155 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:41.861758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80507dc56354aefb2ce74799196e88d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:41.862482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80507dc56354aefb2ce74799196e88d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:41.863098 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80507dc56354aefb2ce74799196e88d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:41.871551 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80507dc56354aefb2ce74799196e88d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:41.879337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80507dc56354aefb2ce74799196e88d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:41.902320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1289/2563] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:41 2022] DELETE /identity/v3/users/e80507dc56354aefb2ce74799196e88d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:41.907236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58ad72-f7d3-48f8-8150-a07b1cbf71d9 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.907517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58ad72-f7d3-48f8-8150-a07b1cbf71d9 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.907791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58ad72-f7d3-48f8-8150-a07b1cbf71d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.927615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ec58ad72-f7d3-48f8-8150-a07b1cbf71d9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:41.928855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ec58ad72-f7d3-48f8-8150-a07b1cbf71d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:41.996466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1275/2564] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:42.006137 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:42.007546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:42.078502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320186d-2aa6-46a0-8531-22a6234a1770 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:42.082728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc509fb2-4214-45e7-8f59-019a2f2cf63c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:42.083576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509fb2-4214-45e7-8f59-019a2f2cf63c service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.084067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509fb2-4214-45e7-8f59-019a2f2cf63c service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.084542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509fb2-4214-45e7-8f59-019a2f2cf63c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.096676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc509fb2-4214-45e7-8f59-019a2f2cf63c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.098155 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc509fb2-4214-45e7-8f59-019a2f2cf63c service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.109164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1290/2565] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:42.404170 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58ad72-f7d3-48f8-8150-a07b1cbf71d9 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:42.406344 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ec58ad72-f7d3-48f8-8150-a07b1cbf71d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:42.419387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58ad72-f7d3-48f8-8150-a07b1cbf71d9 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:42.426133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:42.427254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.427513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.427744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] PATH_INFO: `/v3/projects/1060c66257694343a1a7a9eca7fee6b7` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.429433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1060c66257694343a1a7a9eca7fee6b7)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.431378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.433371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:42.487700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1060c66257694343a1a7a9eca7fee6b7', 'request_id': 'req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.495404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1060c66257694343a1a7a9eca7fee6b7', 'request_id': 'req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.502287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1060c66257694343a1a7a9eca7fee6b7', 'request_id': 'req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.513243 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] The token cache is being invalidate because project 1060c66257694343a1a7a9eca7fee6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:42.513533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.514204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-21cf6267-b5ab-4a70-98cb-ee4e5a7f0888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.515802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1276/2566] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:42 2022] DELETE /identity/v3/projects/1060c66257694343a1a7a9eca7fee6b7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:42.520677 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83488f-c720-4725-99d6-f64d644966d6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.521145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83488f-c720-4725-99d6-f64d644966d6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.521264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83488f-c720-4725-99d6-f64d644966d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.540521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5e83488f-c720-4725-99d6-f64d644966d6 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:42.542698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5e83488f-c720-4725-99d6-f64d644966d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:42.547250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:42.606847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1291/2567] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:42.614725 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76668a-3b9f-416f-a1a0-e493d7e46acc None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.615014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76668a-3b9f-416f-a1a0-e493d7e46acc None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.615423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76668a-3b9f-416f-a1a0-e493d7e46acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.636391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-2c76668a-3b9f-416f-a1a0-e493d7e46acc None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:42.637632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2c76668a-3b9f-416f-a1a0-e493d7e46acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:42.646180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1277/2568] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:42.650974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83488f-c720-4725-99d6-f64d644966d6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:42.663727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83488f-c720-4725-99d6-f64d644966d6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:42.669381 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe1212-0909-4f00-91b0-659a9c432c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:42.670077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1212-0909-4f00-91b0-659a9c432c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.670358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1212-0909-4f00-91b0-659a9c432c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.670628 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1212-0909-4f00-91b0-659a9c432c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.671355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe1212-0909-4f00-91b0-659a9c432c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:42.671657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe1212-0909-4f00-91b0-659a9c432c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.673318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe1212-0909-4f00-91b0-659a9c432c84 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.687617 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1292/2569] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:07:42.692022 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76668a-3b9f-416f-a1a0-e493d7e46acc None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:42.705810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76668a-3b9f-416f-a1a0-e493d7e46acc None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:42.710744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf7112-52f5-4318-82da-329fefcfaa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:42.711405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf7112-52f5-4318-82da-329fefcfaa3a admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.711693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf7112-52f5-4318-82da-329fefcfaa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.711967 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf7112-52f5-4318-82da-329fefcfaa3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.712664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf7112-52f5-4318-82da-329fefcfaa3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.715169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf7112-52f5-4318-82da-329fefcfaa3a admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.745766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1278/2570] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:42 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:42.750315 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe1212-0909-4f00-91b0-659a9c432c84 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:42.761128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe1212-0909-4f00-91b0-659a9c432c84 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:42.820673 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070b0bd-3aa4-4800-a34d-c1a69cb2c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:42.821354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b0bd-3aa4-4800-a34d-c1a69cb2c028 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.821633 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b0bd-3aa4-4800-a34d-c1a69cb2c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.821936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b0bd-3aa4-4800-a34d-c1a69cb2c028 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.822699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070b0bd-3aa4-4800-a34d-c1a69cb2c028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.824615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070b0bd-3aa4-4800-a34d-c1a69cb2c028 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.848293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1293/2571] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:42 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:07:42.852828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf7112-52f5-4318-82da-329fefcfaa3a admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:42.864862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf7112-52f5-4318-82da-329fefcfaa3a admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:42.870791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd500c9-ebae-41d6-955c-c8d3061b7ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:42.871477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd500c9-ebae-41d6-955c-c8d3061b7ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.871808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd500c9-ebae-41d6-955c-c8d3061b7ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.872085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd500c9-ebae-41d6-955c-c8d3061b7ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.872817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd500c9-ebae-41d6-955c-c8d3061b7ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.874463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd500c9-ebae-41d6-955c-c8d3061b7ac7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.886026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1279/2572] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:42.890210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070b0bd-3aa4-4800-a34d-c1a69cb2c028 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:42.900560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070b0bd-3aa4-4800-a34d-c1a69cb2c028 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:42.905865 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59f065-d604-448b-8810-01a0caa5063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:42.906631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f065-d604-448b-8810-01a0caa5063e admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.906917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f065-d604-448b-8810-01a0caa5063e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.907194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f065-d604-448b-8810-01a0caa5063e admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.907921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59f065-d604-448b-8810-01a0caa5063e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.909512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59f065-d604-448b-8810-01a0caa5063e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.920535 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1294/2573] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:42.925134 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd500c9-ebae-41d6-955c-c8d3061b7ac7 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:42.938527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd500c9-ebae-41d6-955c-c8d3061b7ac7 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:42.943479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d00916-86e4-4837-8f93-a4cc44bf538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:42.944373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00916-86e4-4837-8f93-a4cc44bf538d admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.944660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00916-86e4-4837-8f93-a4cc44bf538d admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.944939 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00916-86e4-4837-8f93-a4cc44bf538d admin admin] PATH_INFO: `/v3/projects/30351c061b2742ce8e93e9c38d2f78c9/users/e04c0dab6af3466caf63077094019093/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.962630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d00916-86e4-4837-8f93-a4cc44bf538d admin admin] RBAC: Authorizing `identity:create_grant(project_id=30351c061b2742ce8e93e9c38d2f78c9, user_id=e04c0dab6af3466caf63077094019093, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.966051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d00916-86e4-4837-8f93-a4cc44bf538d admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.981026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1280/2574] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:42 2022] PUT /identity/v3/projects/30351c061b2742ce8e93e9c38d2f78c9/users/e04c0dab6af3466caf63077094019093/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:42.991635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6db4b-5729-4f60-b7b8-6e31a916b04b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.991924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6db4b-5729-4f60-b7b8-6e31a916b04b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.992203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6db4b-5729-4f60-b7b8-6e31a916b04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:43.022433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c2c6db4b-5729-4f60-b7b8-6e31a916b04b None None] MFA Rules not processed for user `e04c0dab6af3466caf63077094019093`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:43.027037 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c2c6db4b-5729-4f60-b7b8-6e31a916b04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:43.101229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1a51c-a0f0-497d-9d04-f44b8eae0759 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:43.101497 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1a51c-a0f0-497d-9d04-f44b8eae0759 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:43.101778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1a51c-a0f0-497d-9d04-f44b8eae0759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:43.115276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1295/2575] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:07:43.122190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-49a1a51c-a0f0-497d-9d04-f44b8eae0759 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:43.123430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-49a1a51c-a0f0-497d-9d04-f44b8eae0759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:43.127246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6db4b-5729-4f60-b7b8-6e31a916b04b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:43.128745 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c2c6db4b-5729-4f60-b7b8-6e31a916b04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:43.136311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:43.203569 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6db4b-5729-4f60-b7b8-6e31a916b04b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:43.204731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1281/2576] 10.222.0.90 () {58 vars in 1016 bytes} [Thu Jun 16 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:07:43.208025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a46b9-8812-4b39-bebd-403a770d15d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:43.208683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a46b9-8812-4b39-bebd-403a770d15d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:43.208969 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a46b9-8812-4b39-bebd-403a770d15d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:43.209248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a46b9-8812-4b39-bebd-403a770d15d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:43.220742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a46b9-8812-4b39-bebd-403a770d15d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:43.222229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a46b9-8812-4b39-bebd-403a770d15d5 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:43.233828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1296/2577] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:07:43.236528 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1a51c-a0f0-497d-9d04-f44b8eae0759 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:43.237957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-49a1a51c-a0f0-497d-9d04-f44b8eae0759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:43.273162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:43.327758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1a51c-a0f0-497d-9d04-f44b8eae0759 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:43.333633 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fccb9a-648b-43c6-b2c8-400fba6fb45e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:43.334333 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fccb9a-648b-43c6-b2c8-400fba6fb45e service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:43.334615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fccb9a-648b-43c6-b2c8-400fba6fb45e service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:43.334891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fccb9a-648b-43c6-b2c8-400fba6fb45e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:43.345916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fccb9a-648b-43c6-b2c8-400fba6fb45e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:43.347534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fccb9a-648b-43c6-b2c8-400fba6fb45e service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:43.358457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1282/2578] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:48.340382 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9fe7-bf64-4cbd-addc-2a25c50201b6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:48.340970 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9fe7-bf64-4cbd-addc-2a25c50201b6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:48.340970 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9fe7-bf64-4cbd-addc-2a25c50201b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:48.361829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-796b9fe7-bf64-4cbd-addc-2a25c50201b6 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:48.363093 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-796b9fe7-bf64-4cbd-addc-2a25c50201b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:48.371422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1297/2579] 10.222.0.90 () {58 vars in 1016 bytes} [Thu Jun 16 15:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:48.430570 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fccb9a-648b-43c6-b2c8-400fba6fb45e service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:48.432351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-99fccb9a-648b-43c6-b2c8-400fba6fb45e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:48.448101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fccb9a-648b-43c6-b2c8-400fba6fb45e service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:48.453964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f985f-09fd-4af5-a659-cb1d11acd6cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:48.454632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f985f-09fd-4af5-a659-cb1d11acd6cd service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:48.454919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f985f-09fd-4af5-a659-cb1d11acd6cd service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:48.455198 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f985f-09fd-4af5-a659-cb1d11acd6cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:48.465526 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f985f-09fd-4af5-a659-cb1d11acd6cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:48.467185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f985f-09fd-4af5-a659-cb1d11acd6cd service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:48.477661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1283/2580] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:53.760845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabceb23-6f1a-4e4d-8c95-6807484d5fd5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:53.761535 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabceb23-6f1a-4e4d-8c95-6807484d5fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:53.761535 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabceb23-6f1a-4e4d-8c95-6807484d5fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:53.780816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-dabceb23-6f1a-4e4d-8c95-6807484d5fd5 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:53.782726 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dabceb23-6f1a-4e4d-8c95-6807484d5fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:53.794655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1298/2581] 10.222.0.90 () {58 vars in 1016 bytes} [Thu Jun 16 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:07:53.865412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f985f-09fd-4af5-a659-cb1d11acd6cd service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:53.878736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f985f-09fd-4af5-a659-cb1d11acd6cd service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:53.884670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f62a37-9af3-449b-aae5-c702602f3b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:53.885328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62a37-9af3-449b-aae5-c702602f3b45 service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:53.885607 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62a37-9af3-449b-aae5-c702602f3b45 service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:53.885878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62a37-9af3-449b-aae5-c702602f3b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:53.899506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f62a37-9af3-449b-aae5-c702602f3b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:53.901728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f62a37-9af3-449b-aae5-c702602f3b45 service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:53.911590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1284/2582] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:59.030916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabceb23-6f1a-4e4d-8c95-6807484d5fd5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:59.044971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabceb23-6f1a-4e4d-8c95-6807484d5fd5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:59.049589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:59.050505 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:59.050790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:59.051067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] PATH_INFO: `/v3/users/e04c0dab6af3466caf63077094019093` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:59.052261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04c0dab6af3466caf63077094019093)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:59.054202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:59.109046 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04c0dab6af3466caf63077094019093'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:59.109709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04c0dab6af3466caf63077094019093'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:59.110352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04c0dab6af3466caf63077094019093'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:59.117231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04c0dab6af3466caf63077094019093'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:59.125252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04c0dab6af3466caf63077094019093'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:59.143304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1299/2583] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:59 2022] DELETE /identity/v3/users/e04c0dab6af3466caf63077094019093 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:59.148067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a4b6-3b99-45fa-b70a-682ace2235ed None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:59.148538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a4b6-3b99-45fa-b70a-682ace2235ed None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:59.148649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a4b6-3b99-45fa-b70a-682ace2235ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:59.167304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-e3c7a4b6-3b99-45fa-b70a-682ace2235ed None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:59.168659 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e3c7a4b6-3b99-45fa-b70a-682ace2235ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:59.229105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1285/2584] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:59.239110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:59.240547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:59.306028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d93b6-2957-4fb1-85bc-dd9404a7bd3e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:59.310668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064079b6-ee77-4257-9064-aa94168bf07c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:59.311332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064079b6-ee77-4257-9064-aa94168bf07c service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:59.311616 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064079b6-ee77-4257-9064-aa94168bf07c service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:59.311889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064079b6-ee77-4257-9064-aa94168bf07c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:59.321538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064079b6-ee77-4257-9064-aa94168bf07c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:59.323913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064079b6-ee77-4257-9064-aa94168bf07c service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:59.334234 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1300/2585] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:59.637937 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7a4b6-3b99-45fa-b70a-682ace2235ed None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:59.639428 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e3c7a4b6-3b99-45fa-b70a-682ace2235ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:59.662614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7a4b6-3b99-45fa-b70a-682ace2235ed None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:59.670004 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:59.670801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:59.671060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:59.671837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] PATH_INFO: `/v3/projects/30351c061b2742ce8e93e9c38d2f78c9` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:59.672648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30351c061b2742ce8e93e9c38d2f78c9)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:59.674765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:59.726018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30351c061b2742ce8e93e9c38d2f78c9', 'request_id': 'req-e88f1798-436c-434e-a7e7-b1e6d923fd97'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:59.735783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30351c061b2742ce8e93e9c38d2f78c9', 'request_id': 'req-e88f1798-436c-434e-a7e7-b1e6d923fd97'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:59.742324 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30351c061b2742ce8e93e9c38d2f78c9', 'request_id': 'req-e88f1798-436c-434e-a7e7-b1e6d923fd97'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:59.753907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] The token cache is being invalidate because project 30351c061b2742ce8e93e9c38d2f78c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:59.754196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:59.754845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:59.756378 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1286/2586] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:59 2022] DELETE /identity/v3/projects/30351c061b2742ce8e93e9c38d2f78c9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:59.762319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf94f-be37-4279-9eda-b84c75b61bee None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:59.762619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf94f-be37-4279-9eda-b84c75b61bee None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:59.762899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf94f-be37-4279-9eda-b84c75b61bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:59.781371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e3bbf94f-be37-4279-9eda-b84c75b61bee None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:59.782632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e3bbf94f-be37-4279-9eda-b84c75b61bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:59.787077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:59.811370 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:59.812943 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:59.832168 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:59.870593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1301/2587] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:59.878790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21a9f4-b351-48c6-893d-3640bcc672f2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:59.879166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21a9f4-b351-48c6-893d-3640bcc672f2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:59.879590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21a9f4-b351-48c6-893d-3640bcc672f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:59.903053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9f21a9f4-b351-48c6-893d-3640bcc672f2 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:59.909997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9f21a9f4-b351-48c6-893d-3640bcc672f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:59.914389 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f1798-436c-434e-a7e7-b1e6d923fd97 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:59.916392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1302/2588] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:07:59.920794 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21a9f4-b351-48c6-893d-3640bcc672f2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:59.928032 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c78ba-8e0b-46cc-ac2d-7114e888e23a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:59.928733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c78ba-8e0b-46cc-ac2d-7114e888e23a service nova] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:59.929020 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c78ba-8e0b-46cc-ac2d-7114e888e23a service nova] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:59.929293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c78ba-8e0b-46cc-ac2d-7114e888e23a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:59.932667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-be2c78ba-8e0b-46cc-ac2d-7114e888e23a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:59.937606 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21a9f4-b351-48c6-893d-3640bcc672f2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:59.950825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4103e0-94f5-408f-bd7a-c27794190ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:59.951644 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4103e0-94f5-408f-bd7a-c27794190ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:59.951806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4103e0-94f5-408f-bd7a-c27794190ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:59.952182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4103e0-94f5-408f-bd7a-c27794190ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:59.953459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4103e0-94f5-408f-bd7a-c27794190ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:59.953811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4103e0-94f5-408f-bd7a-c27794190ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:59.958660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4103e0-94f5-408f-bd7a-c27794190ac0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:59.972772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1303/2589] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:07:59.977654 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4103e0-94f5-408f-bd7a-c27794190ac0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:59.991678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4103e0-94f5-408f-bd7a-c27794190ac0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:59.998527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18cbb7-d2bf-4746-a53c-4ad3773f529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:59.998807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18cbb7-d2bf-4746-a53c-4ad3773f529b admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:59.999001 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18cbb7-d2bf-4746-a53c-4ad3773f529b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.000275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18cbb7-d2bf-4746-a53c-4ad3773f529b admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.000275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18cbb7-d2bf-4746-a53c-4ad3773f529b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:00.002319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18cbb7-d2bf-4746-a53c-4ad3773f529b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:00.017295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c78ba-8e0b-46cc-ac2d-7114e888e23a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:00.018957 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c78ba-8e0b-46cc-ac2d-7114e888e23a service nova] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:00.035803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1304/2590] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:59 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:00.039814 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18cbb7-d2bf-4746-a53c-4ad3773f529b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:00.045707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1287/2591] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:08:00.115165 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18cbb7-d2bf-4746-a53c-4ad3773f529b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:00.123003 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf9da1-464d-4fc8-a796-4db7753bc445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:00.123902 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf9da1-464d-4fc8-a796-4db7753bc445 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:00.124406 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf9da1-464d-4fc8-a796-4db7753bc445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.124687 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf9da1-464d-4fc8-a796-4db7753bc445 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.125383 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf9da1-464d-4fc8-a796-4db7753bc445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:00.127370 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf9da1-464d-4fc8-a796-4db7753bc445 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:00.152968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1305/2592] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:00 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:08:00.155046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c78ba-8e0b-46cc-ac2d-7114e888e23a service nova] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:00.166550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c78ba-8e0b-46cc-ac2d-7114e888e23a service nova] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:00.171678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d0c29-cf45-459f-9f24-bd3990eef666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:00.172367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0c29-cf45-459f-9f24-bd3990eef666 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:00.172747 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0c29-cf45-459f-9f24-bd3990eef666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.173113 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0c29-cf45-459f-9f24-bd3990eef666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.173877 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d0c29-cf45-459f-9f24-bd3990eef666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:00.175511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d0c29-cf45-459f-9f24-bd3990eef666 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:00.194664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1288/2593] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:00.200145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf9da1-464d-4fc8-a796-4db7753bc445 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:00.210477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf9da1-464d-4fc8-a796-4db7753bc445 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:00.216005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76b6aa-cc2e-4fba-95eb-6063c4555496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:00.216679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76b6aa-cc2e-4fba-95eb-6063c4555496 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:00.216956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76b6aa-cc2e-4fba-95eb-6063c4555496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.217226 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76b6aa-cc2e-4fba-95eb-6063c4555496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.217976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76b6aa-cc2e-4fba-95eb-6063c4555496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:00.219754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76b6aa-cc2e-4fba-95eb-6063c4555496 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:00.231263 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1306/2594] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:00.235306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d0c29-cf45-459f-9f24-bd3990eef666 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:00.248331 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d0c29-cf45-459f-9f24-bd3990eef666 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:00.254116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a88018-2d93-48bf-a7ba-e75aee2e234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:00.255066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a88018-2d93-48bf-a7ba-e75aee2e234e admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:00.255332 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a88018-2d93-48bf-a7ba-e75aee2e234e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.255598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a88018-2d93-48bf-a7ba-e75aee2e234e admin admin] PATH_INFO: `/v3/projects/43341802b47441c3abb8c9f06a7d5ad5/users/9f575bbac76a49cfb8a5d52db84830dc/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.274415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a88018-2d93-48bf-a7ba-e75aee2e234e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43341802b47441c3abb8c9f06a7d5ad5, user_id=9f575bbac76a49cfb8a5d52db84830dc, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:00.278214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a88018-2d93-48bf-a7ba-e75aee2e234e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:00.294309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1289/2595] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:00 2022] PUT /identity/v3/projects/43341802b47441c3abb8c9f06a7d5ad5/users/9f575bbac76a49cfb8a5d52db84830dc/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:00.306039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff5ad-32bb-4c5a-87eb-d52a10cebf0e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:00.307501 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff5ad-32bb-4c5a-87eb-d52a10cebf0e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.307846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff5ad-32bb-4c5a-87eb-d52a10cebf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.341222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3bfff5ad-32bb-4c5a-87eb-d52a10cebf0e None None] MFA Rules not processed for user `9f575bbac76a49cfb8a5d52db84830dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:00.343286 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3bfff5ad-32bb-4c5a-87eb-d52a10cebf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:00.390058 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:00.434045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1307/2596] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:00.438783 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a88018-2d93-48bf-a7ba-e75aee2e234e admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:00.509245 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a88018-2d93-48bf-a7ba-e75aee2e234e admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:00.515258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d9789-9bc3-4a94-bccf-6fb6346c9325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:00.515931 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d9789-9bc3-4a94-bccf-6fb6346c9325 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:00.516215 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d9789-9bc3-4a94-bccf-6fb6346c9325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.516491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d9789-9bc3-4a94-bccf-6fb6346c9325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.517198 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d9789-9bc3-4a94-bccf-6fb6346c9325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:00.519159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d9789-9bc3-4a94-bccf-6fb6346c9325 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:00.523393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:00.547274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1290/2597] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:00 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:00.551692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfff5ad-32bb-4c5a-87eb-d52a10cebf0e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:00.564536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfff5ad-32bb-4c5a-87eb-d52a10cebf0e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:00.624859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c90f7-cdec-474a-9eaf-b2bda8e5b4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:00.625533 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c90f7-cdec-474a-9eaf-b2bda8e5b4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:00.625813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c90f7-cdec-474a-9eaf-b2bda8e5b4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.626112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c90f7-cdec-474a-9eaf-b2bda8e5b4d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.626813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c90f7-cdec-474a-9eaf-b2bda8e5b4d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:00.628710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c90f7-cdec-474a-9eaf-b2bda8e5b4d4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:00.649376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1308/2598] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:00 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:08:00.653628 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d9789-9bc3-4a94-bccf-6fb6346c9325 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:00.664744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d9789-9bc3-4a94-bccf-6fb6346c9325 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:00.670441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7c24c-c1a9-4dc4-a192-a52ac525e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:00.671107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7c24c-c1a9-4dc4-a192-a52ac525e959 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:00.671385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7c24c-c1a9-4dc4-a192-a52ac525e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.671657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7c24c-c1a9-4dc4-a192-a52ac525e959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.672375 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7c24c-c1a9-4dc4-a192-a52ac525e959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:00.673981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7c24c-c1a9-4dc4-a192-a52ac525e959 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:00.685468 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1291/2599] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:00.689537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c90f7-cdec-474a-9eaf-b2bda8e5b4d4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:00.700108 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c90f7-cdec-474a-9eaf-b2bda8e5b4d4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:00.704694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095ddc2-f8d1-43c8-9b9c-314b75e79cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:00.705356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095ddc2-f8d1-43c8-9b9c-314b75e79cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:00.705637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095ddc2-f8d1-43c8-9b9c-314b75e79cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.705946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095ddc2-f8d1-43c8-9b9c-314b75e79cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.706670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095ddc2-f8d1-43c8-9b9c-314b75e79cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:00.708258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095ddc2-f8d1-43c8-9b9c-314b75e79cf6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:00.723010 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1309/2600] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:00.729850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7c24c-c1a9-4dc4-a192-a52ac525e959 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:00.747039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7c24c-c1a9-4dc4-a192-a52ac525e959 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:00.754096 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8f48c-66a4-4552-91d6-cf1bfee3eef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:00.755565 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8f48c-66a4-4552-91d6-cf1bfee3eef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:00.756024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8f48c-66a4-4552-91d6-cf1bfee3eef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.756515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8f48c-66a4-4552-91d6-cf1bfee3eef2 admin admin] PATH_INFO: `/v3/projects/cb73daae910c493698271592d9c862b4/users/159efd31277f45f4ae8a0dffbed0aa8b/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.782656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8f48c-66a4-4552-91d6-cf1bfee3eef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb73daae910c493698271592d9c862b4, user_id=159efd31277f45f4ae8a0dffbed0aa8b, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:00.786759 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8f48c-66a4-4552-91d6-cf1bfee3eef2 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:00.804089 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1292/2601] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:00 2022] PUT /identity/v3/projects/cb73daae910c493698271592d9c862b4/users/159efd31277f45f4ae8a0dffbed0aa8b/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:00.818118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d5f55-343a-45fc-9c75-c884ef31e021 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:00.818544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d5f55-343a-45fc-9c75-c884ef31e021 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:00.818935 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d5f55-343a-45fc-9c75-c884ef31e021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:00.845534 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-bf3d5f55-343a-45fc-9c75-c884ef31e021 None None] MFA Rules not processed for user `159efd31277f45f4ae8a0dffbed0aa8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:00.846774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bf3d5f55-343a-45fc-9c75-c884ef31e021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:00.921072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1310/2602] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:00.925594 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8f48c-66a4-4552-91d6-cf1bfee3eef2 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:00.994829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8f48c-66a4-4552-91d6-cf1bfee3eef2 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:00.999667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9d360-5e6d-48ee-9c4e-a16d75ed7027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:01.000339 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d360-5e6d-48ee-9c4e-a16d75ed7027 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:01.000632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d360-5e6d-48ee-9c4e-a16d75ed7027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:01.000902 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d360-5e6d-48ee-9c4e-a16d75ed7027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:01.001673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9d360-5e6d-48ee-9c4e-a16d75ed7027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:01.004273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9d360-5e6d-48ee-9c4e-a16d75ed7027 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:01.033788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1293/2603] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:00 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:01.045176 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d5f55-343a-45fc-9c75-c884ef31e021 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:01.057810 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d5f55-343a-45fc-9c75-c884ef31e021 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:01.120847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:01.143264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa41643-081e-454d-8a92-831fd446a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:01.144013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa41643-081e-454d-8a92-831fd446a77e admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:01.144301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa41643-081e-454d-8a92-831fd446a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:01.144578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa41643-081e-454d-8a92-831fd446a77e admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:01.145280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa41643-081e-454d-8a92-831fd446a77e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:01.147276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa41643-081e-454d-8a92-831fd446a77e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:01.175074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1311/2604] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:01 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:01.178907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9d360-5e6d-48ee-9c4e-a16d75ed7027 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:01.192145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9d360-5e6d-48ee-9c4e-a16d75ed7027 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:01.198687 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24625d72-ad7e-423d-b249-9949304e0157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:01.199525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24625d72-ad7e-423d-b249-9949304e0157 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:01.200021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24625d72-ad7e-423d-b249-9949304e0157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:01.200337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24625d72-ad7e-423d-b249-9949304e0157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:01.201248 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24625d72-ad7e-423d-b249-9949304e0157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:01.203764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24625d72-ad7e-423d-b249-9949304e0157 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:01.232469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1294/2605] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:08:01.237593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa41643-081e-454d-8a92-831fd446a77e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:01.256451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa41643-081e-454d-8a92-831fd446a77e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:01.262124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d61ab-d7b8-406f-901a-f7283a335609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:01.263172 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d61ab-d7b8-406f-901a-f7283a335609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:01.263546 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d61ab-d7b8-406f-901a-f7283a335609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:01.263923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d61ab-d7b8-406f-901a-f7283a335609 admin admin] PATH_INFO: `/v3/projects/7fcaba21e78d40d5a763e36a1c6c2188/users/215df4336f2141d1a066b8e51b7ad46e/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:01.282310 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d61ab-d7b8-406f-901a-f7283a335609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcaba21e78d40d5a763e36a1c6c2188, user_id=215df4336f2141d1a066b8e51b7ad46e, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:01.285812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d61ab-d7b8-406f-901a-f7283a335609 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:01.306539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1312/2606] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:01 2022] PUT /identity/v3/projects/7fcaba21e78d40d5a763e36a1c6c2188/users/215df4336f2141d1a066b8e51b7ad46e/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:01.312076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24625d72-ad7e-423d-b249-9949304e0157 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:01.325175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24625d72-ad7e-423d-b249-9949304e0157 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:01.395561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7aa319-e4c4-4563-a72d-3725d5ce5988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:01.396426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7aa319-e4c4-4563-a72d-3725d5ce5988 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:01.396800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7aa319-e4c4-4563-a72d-3725d5ce5988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:01.397085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7aa319-e4c4-4563-a72d-3725d5ce5988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:01.397810 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7aa319-e4c4-4563-a72d-3725d5ce5988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:01.399450 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7aa319-e4c4-4563-a72d-3725d5ce5988 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:01.411845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1295/2607] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:01.416176 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d61ab-d7b8-406f-901a-f7283a335609 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:01.427772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d61ab-d7b8-406f-901a-f7283a335609 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:01.433340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116284e9-075f-4fa6-b2a1-8efdaeedce76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:01.434373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116284e9-075f-4fa6-b2a1-8efdaeedce76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:01.434678 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116284e9-075f-4fa6-b2a1-8efdaeedce76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:01.434960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116284e9-075f-4fa6-b2a1-8efdaeedce76 admin admin] PATH_INFO: `/v3/projects/7fcaba21e78d40d5a763e36a1c6c2188/users/215df4336f2141d1a066b8e51b7ad46e/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:01.437245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116284e9-075f-4fa6-b2a1-8efdaeedce76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcaba21e78d40d5a763e36a1c6c2188, user_id=215df4336f2141d1a066b8e51b7ad46e, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:01.440403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116284e9-075f-4fa6-b2a1-8efdaeedce76 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:01.452558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1313/2608] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:01 2022] PUT /identity/v3/projects/7fcaba21e78d40d5a763e36a1c6c2188/users/215df4336f2141d1a066b8e51b7ad46e/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:01.463338 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bc9f-6bf9-4568-8f2c-50df78c837a7 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:01.463739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bc9f-6bf9-4568-8f2c-50df78c837a7 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:01.464020 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bc9f-6bf9-4568-8f2c-50df78c837a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:01.495443 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ecd6bc9f-6bf9-4568-8f2c-50df78c837a7 None None] MFA Rules not processed for user `215df4336f2141d1a066b8e51b7ad46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:01.496941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ecd6bc9f-6bf9-4568-8f2c-50df78c837a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:01.507933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:01.578426 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1296/2609] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:01.591396 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116284e9-075f-4fa6-b2a1-8efdaeedce76 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:01.593107 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-116284e9-075f-4fa6-b2a1-8efdaeedce76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:01.655857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116284e9-075f-4fa6-b2a1-8efdaeedce76 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:01.659906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2ccd9-bce5-4c64-b28d-8a3e846d1fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:01.660572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2ccd9-bce5-4c64-b28d-8a3e846d1fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:01.660856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2ccd9-bce5-4c64-b28d-8a3e846d1fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:01.661131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2ccd9-bce5-4c64-b28d-8a3e846d1fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:01.725136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2ccd9-bce5-4c64-b28d-8a3e846d1fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:01.726655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2ccd9-bce5-4c64-b28d-8a3e846d1fc5 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:01.737487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1314/2610] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:03.281438 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6bc9f-6bf9-4568-8f2c-50df78c837a7 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:03.283138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ecd6bc9f-6bf9-4568-8f2c-50df78c837a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:03.296623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6bc9f-6bf9-4568-8f2c-50df78c837a7 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:03.300135 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ab934-8cb2-4f78-958c-966499d39168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:03.300790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ab934-8cb2-4f78-958c-966499d39168 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:03.301071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ab934-8cb2-4f78-958c-966499d39168 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:03.301344 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ab934-8cb2-4f78-958c-966499d39168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:03.362814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ab934-8cb2-4f78-958c-966499d39168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:03.364299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ab934-8cb2-4f78-958c-966499d39168 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:03.374290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1297/2611] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:03.972205 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2ccd9-bce5-4c64-b28d-8a3e846d1fc5 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:03.981052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2ccd9-bce5-4c64-b28d-8a3e846d1fc5 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:03.984926 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb66ad-d02a-4ed3-81a3-246e1b66cf25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:03.985581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb66ad-d02a-4ed3-81a3-246e1b66cf25 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:03.985860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb66ad-d02a-4ed3-81a3-246e1b66cf25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:03.986171 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb66ad-d02a-4ed3-81a3-246e1b66cf25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:03.996891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb66ad-d02a-4ed3-81a3-246e1b66cf25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:03.998398 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb66ad-d02a-4ed3-81a3-246e1b66cf25 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:04.010218 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1315/2612] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:07.892308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ab934-8cb2-4f78-958c-966499d39168 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:07.997551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ab934-8cb2-4f78-958c-966499d39168 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:08.002844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:08.003821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:08.004231 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:08.004681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] PATH_INFO: `/v3/users/9f575bbac76a49cfb8a5d52db84830dc` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:08.006184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f575bbac76a49cfb8a5d52db84830dc)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:08.008765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:08.085403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f575bbac76a49cfb8a5d52db84830dc'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:08.086671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:08.095162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f575bbac76a49cfb8a5d52db84830dc'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:08.108132 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f575bbac76a49cfb8a5d52db84830dc'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:08.109204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f575bbac76a49cfb8a5d52db84830dc'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:08.125410 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f575bbac76a49cfb8a5d52db84830dc'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:08.137534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1298/2613] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:07 2022] DELETE /identity/v3/users/9f575bbac76a49cfb8a5d52db84830dc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:08.142463 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39818dc-ab73-423d-ab93-52cb5b300fb5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:08.143250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39818dc-ab73-423d-ab93-52cb5b300fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:08.143250 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39818dc-ab73-423d-ab93-52cb5b300fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:08.174462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c39818dc-ab73-423d-ab93-52cb5b300fb5 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:08.176270 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c39818dc-ab73-423d-ab93-52cb5b300fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:08.220278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:08.269148 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1316/2614] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:08.276893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:08.278668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:08.369733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280789a7-1300-4846-a26a-63fbf8aac6ad admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:08.375593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b3c3e-8c32-4501-a5f2-52299333d3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:08.376679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b3c3e-8c32-4501-a5f2-52299333d3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:08.377427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b3c3e-8c32-4501-a5f2-52299333d3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:08.378104 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b3c3e-8c32-4501-a5f2-52299333d3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:08.401534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b3c3e-8c32-4501-a5f2-52299333d3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:08.403985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b3c3e-8c32-4501-a5f2-52299333d3d3 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:08.420938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1299/2615] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:08.512302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39818dc-ab73-423d-ab93-52cb5b300fb5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:08.513850 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c39818dc-ab73-423d-ab93-52cb5b300fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:08.596528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39818dc-ab73-423d-ab93-52cb5b300fb5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:08.602211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e620f2f-19d3-4b7d-bce8-2ef25687faab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:08.602868 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e620f2f-19d3-4b7d-bce8-2ef25687faab service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:08.604045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e620f2f-19d3-4b7d-bce8-2ef25687faab service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:08.604301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e620f2f-19d3-4b7d-bce8-2ef25687faab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:08.606259 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5e620f2f-19d3-4b7d-bce8-2ef25687faab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:08.618686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e620f2f-19d3-4b7d-bce8-2ef25687faab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:08.620287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e620f2f-19d3-4b7d-bce8-2ef25687faab service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:08.632795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1317/2616] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:08.782386 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b3c3e-8c32-4501-a5f2-52299333d3d3 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:08.783801 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-bc6b3c3e-8c32-4501-a5f2-52299333d3d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:08.800700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b3c3e-8c32-4501-a5f2-52299333d3d3 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:08.808758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:08.809853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:08.809989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:08.810204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] PATH_INFO: `/v3/projects/43341802b47441c3abb8c9f06a7d5ad5` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:08.811474 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43341802b47441c3abb8c9f06a7d5ad5)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:08.813615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:08.875740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43341802b47441c3abb8c9f06a7d5ad5', 'request_id': 'req-5a08edc8-d0ae-44df-913a-e84a6379a645'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:08.886483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43341802b47441c3abb8c9f06a7d5ad5', 'request_id': 'req-5a08edc8-d0ae-44df-913a-e84a6379a645'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:08.893844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43341802b47441c3abb8c9f06a7d5ad5', 'request_id': 'req-5a08edc8-d0ae-44df-913a-e84a6379a645'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:08.906675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] The token cache is being invalidate because project 43341802b47441c3abb8c9f06a7d5ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:08.906968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:08.907664 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:08.909463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1300/2617] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:08 2022] DELETE /identity/v3/projects/43341802b47441c3abb8c9f06a7d5ad5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:08.913805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e620f2f-19d3-4b7d-bce8-2ef25687faab service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:08.924512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e620f2f-19d3-4b7d-bce8-2ef25687faab service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:08.987634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:08.988428 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:08.988711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:08.989017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] PATH_INFO: `/v3/users/159efd31277f45f4ae8a0dffbed0aa8b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:08.990314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=159efd31277f45f4ae8a0dffbed0aa8b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:08.992224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:09.045367 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159efd31277f45f4ae8a0dffbed0aa8b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.046069 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159efd31277f45f4ae8a0dffbed0aa8b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.046686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159efd31277f45f4ae8a0dffbed0aa8b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.056536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159efd31277f45f4ae8a0dffbed0aa8b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.079472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159efd31277f45f4ae8a0dffbed0aa8b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.082571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:09.106123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1318/2618] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:08 2022] DELETE /identity/v3/users/159efd31277f45f4ae8a0dffbed0aa8b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:09.407509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:09.408980 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:09.423787 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08edc8-d0ae-44df-913a-e84a6379a645 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:09.478824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:09.491401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:09.492322 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:09.492608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:09.492883 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] PATH_INFO: `/v3/projects/cb73daae910c493698271592d9c862b4` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:09.494683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb73daae910c493698271592d9c862b4)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:09.496691 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:09.549478 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb73daae910c493698271592d9c862b4', 'request_id': 'req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.558422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb73daae910c493698271592d9c862b4', 'request_id': 'req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.565423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb73daae910c493698271592d9c862b4', 'request_id': 'req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.577419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] The token cache is being invalidate because project cb73daae910c493698271592d9c862b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:09.577734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.578540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.580145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1301/2619] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:09 2022] DELETE /identity/v3/projects/cb73daae910c493698271592d9c862b4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:09.584455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:09.586788 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:09.600233 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905e518-3227-4005-bb3e-91fdc37ec5ab admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:09.669067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de9f91-876b-41a9-abcb-af6f79357062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:09.670095 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de9f91-876b-41a9-abcb-af6f79357062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:09.670487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de9f91-876b-41a9-abcb-af6f79357062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:09.670776 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de9f91-876b-41a9-abcb-af6f79357062 admin admin] PATH_INFO: `/v3/users/215df4336f2141d1a066b8e51b7ad46e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:09.672092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de9f91-876b-41a9-abcb-af6f79357062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=215df4336f2141d1a066b8e51b7ad46e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:09.674173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de9f91-876b-41a9-abcb-af6f79357062 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:09.736645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-15de9f91-876b-41a9-abcb-af6f79357062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215df4336f2141d1a066b8e51b7ad46e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.737328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-15de9f91-876b-41a9-abcb-af6f79357062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215df4336f2141d1a066b8e51b7ad46e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.737978 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-15de9f91-876b-41a9-abcb-af6f79357062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215df4336f2141d1a066b8e51b7ad46e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.746737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-15de9f91-876b-41a9-abcb-af6f79357062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215df4336f2141d1a066b8e51b7ad46e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.755746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-15de9f91-876b-41a9-abcb-af6f79357062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215df4336f2141d1a066b8e51b7ad46e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:09.774875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1319/2620] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:09 2022] DELETE /identity/v3/users/215df4336f2141d1a066b8e51b7ad46e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:10.069471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:10.073133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:10.088345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d50f3-c4e0-4158-9eef-40f5dc4e990b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:10.188938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:10.190003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:10.190405 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:10.190698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] PATH_INFO: `/v3/projects/7fcaba21e78d40d5a763e36a1c6c2188` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:10.192070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcaba21e78d40d5a763e36a1c6c2188)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:10.194198 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:10.254327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcaba21e78d40d5a763e36a1c6c2188', 'request_id': 'req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:10.267231 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcaba21e78d40d5a763e36a1c6c2188', 'request_id': 'req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:10.273840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcaba21e78d40d5a763e36a1c6c2188', 'request_id': 'req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:10.287475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] The token cache is being invalidate because project 7fcaba21e78d40d5a763e36a1c6c2188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:10.287920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:10.288662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4a9abb43-ca62-4bab-a2df-7a0bca6eb6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:10.290483 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1302/2621] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:10 2022] DELETE /identity/v3/projects/7fcaba21e78d40d5a763e36a1c6c2188 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:10.295986 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbdac1-fde6-4286-82e3-fe163d0a8c48 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:10.296287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbdac1-fde6-4286-82e3-fe163d0a8c48 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:10.296609 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbdac1-fde6-4286-82e3-fe163d0a8c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:10.317243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-90fbdac1-fde6-4286-82e3-fe163d0a8c48 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:10.318661 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-90fbdac1-fde6-4286-82e3-fe163d0a8c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:10.387486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1320/2622] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:10.396174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b304790-bdce-4ecc-ab67-38ca28b149fb None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:10.396463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b304790-bdce-4ecc-ab67-38ca28b149fb None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:10.396742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b304790-bdce-4ecc-ab67-38ca28b149fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:10.417377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-1b304790-bdce-4ecc-ab67-38ca28b149fb None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:10.418646 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1b304790-bdce-4ecc-ab67-38ca28b149fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:10.426970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1303/2623] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:10.432591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbdac1-fde6-4286-82e3-fe163d0a8c48 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:10.437643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:10.444309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbdac1-fde6-4286-82e3-fe163d0a8c48 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:10.451381 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ec3f9-c427-4751-8e95-7659cd8fd132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:10.452135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ec3f9-c427-4751-8e95-7659cd8fd132 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:10.452416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ec3f9-c427-4751-8e95-7659cd8fd132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:10.452692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ec3f9-c427-4751-8e95-7659cd8fd132 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:10.453449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ec3f9-c427-4751-8e95-7659cd8fd132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:08:10.453758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ec3f9-c427-4751-8e95-7659cd8fd132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:10.455425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ec3f9-c427-4751-8e95-7659cd8fd132 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:10.468099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1321/2624] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:08:10.472517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b304790-bdce-4ecc-ab67-38ca28b149fb None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:10.478768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:10.486048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b304790-bdce-4ecc-ab67-38ca28b149fb None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:10.492130 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0b3b2-d159-4faf-8939-76685707fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:10.492804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0b3b2-d159-4faf-8939-76685707fed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:10.493085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0b3b2-d159-4faf-8939-76685707fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:10.493364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0b3b2-d159-4faf-8939-76685707fed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:10.495641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0b3b2-d159-4faf-8939-76685707fed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:10.497579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0b3b2-d159-4faf-8939-76685707fed4 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:10.530271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1304/2625] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:10 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:10.534535 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ec3f9-c427-4751-8e95-7659cd8fd132 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:10.548536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ec3f9-c427-4751-8e95-7659cd8fd132 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:10.629462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9de6d-a69b-404e-9298-8465d5830bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:10.630194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9de6d-a69b-404e-9298-8465d5830bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:10.630482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9de6d-a69b-404e-9298-8465d5830bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:10.630754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9de6d-a69b-404e-9298-8465d5830bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:10.631452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9de6d-a69b-404e-9298-8465d5830bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:10.633660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9de6d-a69b-404e-9298-8465d5830bc1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:10.659743 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1322/2626] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:10 2022] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:08:10.663967 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0b3b2-d159-4faf-8939-76685707fed4 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:10.676975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0b3b2-d159-4faf-8939-76685707fed4 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:10.683220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ecb1f-3036-43cc-9b25-0769d5004306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:10.684110 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ecb1f-3036-43cc-9b25-0769d5004306 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:10.684465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ecb1f-3036-43cc-9b25-0769d5004306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:10.685071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ecb1f-3036-43cc-9b25-0769d5004306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:10.685668 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ecb1f-3036-43cc-9b25-0769d5004306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:10.687336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ecb1f-3036-43cc-9b25-0769d5004306 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:10.700169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1305/2627] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:10.704216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9de6d-a69b-404e-9298-8465d5830bc1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:10.719391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9de6d-a69b-404e-9298-8465d5830bc1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:10.724210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503031b-87b7-441e-b109-b2744f256aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:10.724872 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503031b-87b7-441e-b109-b2744f256aab admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:10.725151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503031b-87b7-441e-b109-b2744f256aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:10.725421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503031b-87b7-441e-b109-b2744f256aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:10.726251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503031b-87b7-441e-b109-b2744f256aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:10.728008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503031b-87b7-441e-b109-b2744f256aab admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:10.738719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1323/2628] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:10.742853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ecb1f-3036-43cc-9b25-0769d5004306 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:10.753875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ecb1f-3036-43cc-9b25-0769d5004306 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:10.759808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b143ad-13bc-4182-9a3f-1aad430cf722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:10.760882 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b143ad-13bc-4182-9a3f-1aad430cf722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:10.761188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b143ad-13bc-4182-9a3f-1aad430cf722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:10.761461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b143ad-13bc-4182-9a3f-1aad430cf722 admin admin] PATH_INFO: `/v3/projects/75fabf7ff26941a7a986b6608d70d1e0/users/e18548faba1d4dd0a999a44084fe17f3/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:10.778046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b143ad-13bc-4182-9a3f-1aad430cf722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fabf7ff26941a7a986b6608d70d1e0, user_id=e18548faba1d4dd0a999a44084fe17f3, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:10.780760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b143ad-13bc-4182-9a3f-1aad430cf722 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:10.794416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1306/2629] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:10 2022] PUT /identity/v3/projects/75fabf7ff26941a7a986b6608d70d1e0/users/e18548faba1d4dd0a999a44084fe17f3/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:10.805392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8053-150c-4a0d-94b8-22763d48fd3c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:10.805712 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8053-150c-4a0d-94b8-22763d48fd3c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:10.806565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8053-150c-4a0d-94b8-22763d48fd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:10.833563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-686c8053-150c-4a0d-94b8-22763d48fd3c None None] MFA Rules not processed for user `e18548faba1d4dd0a999a44084fe17f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:10.834825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-686c8053-150c-4a0d-94b8-22763d48fd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:10.913916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1324/2630] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:10.927164 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b143ad-13bc-4182-9a3f-1aad430cf722 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:10.929273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a8b143ad-13bc-4182-9a3f-1aad430cf722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:11.015998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b143ad-13bc-4182-9a3f-1aad430cf722 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:11.022055 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c39999-5b16-4fe2-8a0b-e595d2672656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:11.023107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c39999-5b16-4fe2-8a0b-e595d2672656 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:11.023596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c39999-5b16-4fe2-8a0b-e595d2672656 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:11.024093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c39999-5b16-4fe2-8a0b-e595d2672656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:11.035641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c39999-5b16-4fe2-8a0b-e595d2672656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:11.037519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c39999-5b16-4fe2-8a0b-e595d2672656 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:11.049502 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1307/2631] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:20.910301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:21.051250 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=48,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:22.212488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8053-150c-4a0d-94b8-22763d48fd3c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:22.213945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-686c8053-150c-4a0d-94b8-22763d48fd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:22.273744 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8053-150c-4a0d-94b8-22763d48fd3c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:22.277341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb62e2a-ca02-4b3b-86c0-d8410312f7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:22.278229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb62e2a-ca02-4b3b-86c0-d8410312f7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:22.278657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb62e2a-ca02-4b3b-86c0-d8410312f7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:22.278945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb62e2a-ca02-4b3b-86c0-d8410312f7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:22.280792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cbb62e2a-ca02-4b3b-86c0-d8410312f7b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:22.348532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb62e2a-ca02-4b3b-86c0-d8410312f7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:22.349910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb62e2a-ca02-4b3b-86c0-d8410312f7b7 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:22.361194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1325/2632] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:25.914286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c39999-5b16-4fe2-8a0b-e595d2672656 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:25.915832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-43c39999-5b16-4fe2-8a0b-e595d2672656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:25.940123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c39999-5b16-4fe2-8a0b-e595d2672656 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:25.945020 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daff219-c769-423c-ab0f-ef9527f27c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:25.946017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daff219-c769-423c-ab0f-ef9527f27c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:25.946303 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daff219-c769-423c-ab0f-ef9527f27c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:25.946580 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daff219-c769-423c-ab0f-ef9527f27c7f admin admin] PATH_INFO: `/v3/users/7efff0603fb7461ca799c67a8050e181` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:25.947859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daff219-c769-423c-ab0f-ef9527f27c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7efff0603fb7461ca799c67a8050e181)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:25.951732 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daff219-c769-423c-ab0f-ef9527f27c7f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:26.002186 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7daff219-c769-423c-ab0f-ef9527f27c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7efff0603fb7461ca799c67a8050e181'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:26.009828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7daff219-c769-423c-ab0f-ef9527f27c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7efff0603fb7461ca799c67a8050e181'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:26.029071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7daff219-c769-423c-ab0f-ef9527f27c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7efff0603fb7461ca799c67a8050e181'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:26.030297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7daff219-c769-423c-ab0f-ef9527f27c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7efff0603fb7461ca799c67a8050e181'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:26.041947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7daff219-c769-423c-ab0f-ef9527f27c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7efff0603fb7461ca799c67a8050e181'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:26.048876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1308/2633] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:25 2022] DELETE /identity/v3/users/7efff0603fb7461ca799c67a8050e181 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:26.252184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb62e2a-ca02-4b3b-86c0-d8410312f7b7 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:26.268125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb62e2a-ca02-4b3b-86c0-d8410312f7b7 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:26.338326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:26.339242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:26.339552 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:26.339854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] PATH_INFO: `/v3/projects/08a6102809be485688231879c583e2b9` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:26.341719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08a6102809be485688231879c583e2b9)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:26.343696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:26.395925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08a6102809be485688231879c583e2b9', 'request_id': 'req-aea172d9-7efb-4c76-b30e-c673e20bcd80'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:26.398083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:26.404189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08a6102809be485688231879c583e2b9', 'request_id': 'req-aea172d9-7efb-4c76-b30e-c673e20bcd80'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:26.411417 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08a6102809be485688231879c583e2b9', 'request_id': 'req-aea172d9-7efb-4c76-b30e-c673e20bcd80'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:26.423190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] The token cache is being invalidate because project 08a6102809be485688231879c583e2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:26.423442 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:26.424116 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea172d9-7efb-4c76-b30e-c673e20bcd80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:26.426108 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1326/2634] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:26 2022] DELETE /identity/v3/projects/08a6102809be485688231879c583e2b9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:26.431816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef432b8-cdbb-45ea-9191-957edf66dbc5 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:26.432864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef432b8-cdbb-45ea-9191-957edf66dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:26.432993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef432b8-cdbb-45ea-9191-957edf66dbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:26.456492 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5ef432b8-cdbb-45ea-9191-957edf66dbc5 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:26.458192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5ef432b8-cdbb-45ea-9191-957edf66dbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:26.523608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1309/2635] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:26.532072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9405196-94fd-4e98-84f0-7f783192be2f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:26.532488 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9405196-94fd-4e98-84f0-7f783192be2f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:26.532941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9405196-94fd-4e98-84f0-7f783192be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:26.552646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b9405196-94fd-4e98-84f0-7f783192be2f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:26.553863 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b9405196-94fd-4e98-84f0-7f783192be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:26.563278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1327/2636] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:26.567739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef432b8-cdbb-45ea-9191-957edf66dbc5 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:26.578845 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef432b8-cdbb-45ea-9191-957edf66dbc5 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:26.589390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3607aec-5440-436b-bfc9-4d6a27d54ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:26.590203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3607aec-5440-436b-bfc9-4d6a27d54ced admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:26.590616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3607aec-5440-436b-bfc9-4d6a27d54ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:26.591058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3607aec-5440-436b-bfc9-4d6a27d54ced admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:26.591858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3607aec-5440-436b-bfc9-4d6a27d54ced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:08:26.592169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3607aec-5440-436b-bfc9-4d6a27d54ced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:26.593793 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3607aec-5440-436b-bfc9-4d6a27d54ced admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:26.606319 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1310/2637] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:08:26.611869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9405196-94fd-4e98-84f0-7f783192be2f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:26.625059 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9405196-94fd-4e98-84f0-7f783192be2f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:26.631597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d155d7-0047-4bcf-8898-94c13d698e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:26.632280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d155d7-0047-4bcf-8898-94c13d698e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:26.632813 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d155d7-0047-4bcf-8898-94c13d698e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:26.633088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d155d7-0047-4bcf-8898-94c13d698e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:26.633784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d155d7-0047-4bcf-8898-94c13d698e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:26.635732 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d155d7-0047-4bcf-8898-94c13d698e32 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:26.666143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1328/2638] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:26 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:26.670491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3607aec-5440-436b-bfc9-4d6a27d54ced admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:26.680441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3607aec-5440-436b-bfc9-4d6a27d54ced admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:26.767377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7dbb3-60c1-4c4e-b135-ed51dc0210fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:26.768291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7dbb3-60c1-4c4e-b135-ed51dc0210fd admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:26.768733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7dbb3-60c1-4c4e-b135-ed51dc0210fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:26.769446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7dbb3-60c1-4c4e-b135-ed51dc0210fd admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:26.770493 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7dbb3-60c1-4c4e-b135-ed51dc0210fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:26.772886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7dbb3-60c1-4c4e-b135-ed51dc0210fd admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:26.780841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:26.806823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1311/2639] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:26 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:08:26.812884 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d155d7-0047-4bcf-8898-94c13d698e32 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:26.826527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d155d7-0047-4bcf-8898-94c13d698e32 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:26.833455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a61da-c2a4-4f42-b782-d0d30223a9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:26.834078 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a61da-c2a4-4f42-b782-d0d30223a9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:26.834365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a61da-c2a4-4f42-b782-d0d30223a9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:26.834645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a61da-c2a4-4f42-b782-d0d30223a9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:26.835698 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a61da-c2a4-4f42-b782-d0d30223a9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:26.837457 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a61da-c2a4-4f42-b782-d0d30223a9a0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:26.857957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1329/2640] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:26.861445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7dbb3-60c1-4c4e-b135-ed51dc0210fd admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:26.875796 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7dbb3-60c1-4c4e-b135-ed51dc0210fd admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:26.881601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d07ecd-beb3-429f-bef4-a6a23710d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:26.882312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d07ecd-beb3-429f-bef4-a6a23710d876 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:26.882858 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d07ecd-beb3-429f-bef4-a6a23710d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:26.883141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d07ecd-beb3-429f-bef4-a6a23710d876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:26.883867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d07ecd-beb3-429f-bef4-a6a23710d876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:26.885504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d07ecd-beb3-429f-bef4-a6a23710d876 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:26.899540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1312/2641] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:26.904440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a61da-c2a4-4f42-b782-d0d30223a9a0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:26.915243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a61da-c2a4-4f42-b782-d0d30223a9a0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:26.920964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00efb-6eae-4430-82f5-1021a8f437bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:26.921903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00efb-6eae-4430-82f5-1021a8f437bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:26.922203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00efb-6eae-4430-82f5-1021a8f437bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:26.922484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00efb-6eae-4430-82f5-1021a8f437bc admin admin] PATH_INFO: `/v3/projects/ebfd3102bbf44882bd3640a7ca6078a2/users/d73878d3a7534f44a78b20ab00427e12/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:26.939890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc00efb-6eae-4430-82f5-1021a8f437bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfd3102bbf44882bd3640a7ca6078a2, user_id=d73878d3a7534f44a78b20ab00427e12, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:26.942510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc00efb-6eae-4430-82f5-1021a8f437bc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:26.957029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1330/2642] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:26 2022] PUT /identity/v3/projects/ebfd3102bbf44882bd3640a7ca6078a2/users/d73878d3a7534f44a78b20ab00427e12/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:26.967898 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20c426-1c89-4d2b-9ee3-23e39af0382e None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:26.968460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20c426-1c89-4d2b-9ee3-23e39af0382e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:26.968460 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20c426-1c89-4d2b-9ee3-23e39af0382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:27.004951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ae20c426-1c89-4d2b-9ee3-23e39af0382e None None] MFA Rules not processed for user `d73878d3a7534f44a78b20ab00427e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:27.006358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ae20c426-1c89-4d2b-9ee3-23e39af0382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:27.082190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1313/2643] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:27.083791 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00efb-6eae-4430-82f5-1021a8f437bc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:27.153355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00efb-6eae-4430-82f5-1021a8f437bc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:27.158223 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d98f17-7d99-4ef8-b43d-9535b2cfa6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:27.158898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d98f17-7d99-4ef8-b43d-9535b2cfa6be admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:27.159183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d98f17-7d99-4ef8-b43d-9535b2cfa6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:27.159466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d98f17-7d99-4ef8-b43d-9535b2cfa6be admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:27.160178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d98f17-7d99-4ef8-b43d-9535b2cfa6be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:27.162146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d98f17-7d99-4ef8-b43d-9535b2cfa6be admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:27.189245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1331/2644] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:27 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:27.196547 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20c426-1c89-4d2b-9ee3-23e39af0382e None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:27.208746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20c426-1c89-4d2b-9ee3-23e39af0382e None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:27.275605 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fcfdd-b529-47d1-ac14-814294f998b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:27.276335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fcfdd-b529-47d1-ac14-814294f998b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:27.276569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fcfdd-b529-47d1-ac14-814294f998b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:27.276839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fcfdd-b529-47d1-ac14-814294f998b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:27.278161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fcfdd-b529-47d1-ac14-814294f998b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:27.280217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fcfdd-b529-47d1-ac14-814294f998b7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:27.302719 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1314/2645] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:27 2022] POST /identity/v3/users => generated 309 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:27.306745 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d98f17-7d99-4ef8-b43d-9535b2cfa6be admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:27.320829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d98f17-7d99-4ef8-b43d-9535b2cfa6be admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:27.328034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c6a8e-1ac1-4d93-bfda-3a5f168e27bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:27.328716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c6a8e-1ac1-4d93-bfda-3a5f168e27bc admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:27.328997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c6a8e-1ac1-4d93-bfda-3a5f168e27bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:27.329271 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c6a8e-1ac1-4d93-bfda-3a5f168e27bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:27.330040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c6a8e-1ac1-4d93-bfda-3a5f168e27bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:27.331664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c6a8e-1ac1-4d93-bfda-3a5f168e27bc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:27.346653 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1332/2646] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:27.347891 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fcfdd-b529-47d1-ac14-814294f998b7 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:27.361125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fcfdd-b529-47d1-ac14-814294f998b7 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:27.366252 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bfb1f-2807-49e1-a784-ac4db634dfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:27.367163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bfb1f-2807-49e1-a784-ac4db634dfd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:27.367447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bfb1f-2807-49e1-a784-ac4db634dfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:27.367720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bfb1f-2807-49e1-a784-ac4db634dfd3 admin admin] PATH_INFO: `/v3/projects/84db7aeb6e1e4cbba4bcdcab178ecaae/users/6fd80a70eb7b4a6681837255be5110c5/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:27.384966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bfb1f-2807-49e1-a784-ac4db634dfd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84db7aeb6e1e4cbba4bcdcab178ecaae, user_id=6fd80a70eb7b4a6681837255be5110c5, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:27.388367 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bfb1f-2807-49e1-a784-ac4db634dfd3 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:27.402060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1315/2647] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:27 2022] PUT /identity/v3/projects/84db7aeb6e1e4cbba4bcdcab178ecaae/users/6fd80a70eb7b4a6681837255be5110c5/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:27.406274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c6a8e-1ac1-4d93-bfda-3a5f168e27bc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:27.416525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c6a8e-1ac1-4d93-bfda-3a5f168e27bc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:27.468226 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:27.480307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513b24a-4d3d-443a-af2b-0f6977e278dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:27.481579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513b24a-4d3d-443a-af2b-0f6977e278dd admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:27.481935 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513b24a-4d3d-443a-af2b-0f6977e278dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:27.482206 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513b24a-4d3d-443a-af2b-0f6977e278dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:27.482945 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513b24a-4d3d-443a-af2b-0f6977e278dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:27.484610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513b24a-4d3d-443a-af2b-0f6977e278dd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:27.494866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1333/2648] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:27.499885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bfb1f-2807-49e1-a784-ac4db634dfd3 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:27.510446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bfb1f-2807-49e1-a784-ac4db634dfd3 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:27.515841 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6f837-3479-4a2a-9c93-34f6d0b7b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:27.516660 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6f837-3479-4a2a-9c93-34f6d0b7b122 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:27.516944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6f837-3479-4a2a-9c93-34f6d0b7b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:27.517226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6f837-3479-4a2a-9c93-34f6d0b7b122 admin admin] PATH_INFO: `/v3/projects/84db7aeb6e1e4cbba4bcdcab178ecaae/users/6fd80a70eb7b4a6681837255be5110c5/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:27.519328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6f837-3479-4a2a-9c93-34f6d0b7b122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84db7aeb6e1e4cbba4bcdcab178ecaae, user_id=6fd80a70eb7b4a6681837255be5110c5, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:27.521928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6f837-3479-4a2a-9c93-34f6d0b7b122 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:27.532479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1316/2649] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:27 2022] PUT /identity/v3/projects/84db7aeb6e1e4cbba4bcdcab178ecaae/users/6fd80a70eb7b4a6681837255be5110c5/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:27.544953 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35049c7f-c172-4af6-a2d8-1130011d8a60 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:27.545866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35049c7f-c172-4af6-a2d8-1130011d8a60 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:27.546190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35049c7f-c172-4af6-a2d8-1130011d8a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:27.575728 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-35049c7f-c172-4af6-a2d8-1130011d8a60 None None] MFA Rules not processed for user `6fd80a70eb7b4a6681837255be5110c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:27.576997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-35049c7f-c172-4af6-a2d8-1130011d8a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:27.676330 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1334/2650] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:27 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:27.689230 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6f837-3479-4a2a-9c93-34f6d0b7b122 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:27.691124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-53c6f837-3479-4a2a-9c93-34f6d0b7b122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:27.717138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:27.768775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6f837-3479-4a2a-9c93-34f6d0b7b122 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:27.772336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31a57d-f78b-47e4-b5a4-ec292837d0e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:27.772985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31a57d-f78b-47e4-b5a4-ec292837d0e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:27.773264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31a57d-f78b-47e4-b5a4-ec292837d0e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:27.773535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31a57d-f78b-47e4-b5a4-ec292837d0e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:27.783282 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31a57d-f78b-47e4-b5a4-ec292837d0e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:27.784729 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31a57d-f78b-47e4-b5a4-ec292837d0e7 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:27.794784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1317/2651] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:27 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:08:27.975287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35049c7f-c172-4af6-a2d8-1130011d8a60 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:28.096194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35049c7f-c172-4af6-a2d8-1130011d8a60 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:28.101311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:28.102635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:28.103095 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:28.103460 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] PATH_INFO: `/v3/users/d73878d3a7534f44a78b20ab00427e12` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:28.106784 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73878d3a7534f44a78b20ab00427e12)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:28.109927 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:28.172087 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73878d3a7534f44a78b20ab00427e12'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:28.173113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73878d3a7534f44a78b20ab00427e12'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:28.173991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73878d3a7534f44a78b20ab00427e12'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:28.183056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73878d3a7534f44a78b20ab00427e12'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:28.194915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73878d3a7534f44a78b20ab00427e12'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:28.205942 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:28.227693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1335/2652] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:27 2022] DELETE /identity/v3/users/d73878d3a7534f44a78b20ab00427e12 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:28.232658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f76d5-7fe2-4c78-93b7-71689166053f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:28.233235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f76d5-7fe2-4c78-93b7-71689166053f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:28.233358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f76d5-7fe2-4c78-93b7-71689166053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:28.252788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d60f76d5-7fe2-4c78-93b7-71689166053f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:28.254057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d60f76d5-7fe2-4c78-93b7-71689166053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:28.326833 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1318/2653] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:28.338043 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:28.340968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:28.424188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2ad0c-5152-42a0-b344-2f0af92d1ddc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:28.430753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478ff31-571a-4912-81de-21a1f58814d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:28.431538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478ff31-571a-4912-81de-21a1f58814d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:28.431957 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478ff31-571a-4912-81de-21a1f58814d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:28.432283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478ff31-571a-4912-81de-21a1f58814d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:28.444444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478ff31-571a-4912-81de-21a1f58814d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:28.446025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478ff31-571a-4912-81de-21a1f58814d0 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:28.457164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1336/2654] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:28.765387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f76d5-7fe2-4c78-93b7-71689166053f None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:28.766881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d60f76d5-7fe2-4c78-93b7-71689166053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:28.780017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f76d5-7fe2-4c78-93b7-71689166053f None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:28.784892 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:28.785778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:28.786100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:28.786383 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] PATH_INFO: `/v3/projects/ebfd3102bbf44882bd3640a7ca6078a2` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:28.787611 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebfd3102bbf44882bd3640a7ca6078a2)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:28.789521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:28.841780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebfd3102bbf44882bd3640a7ca6078a2', 'request_id': 'req-df16d368-095e-4931-95ca-fd0b739b44e5'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:28.849549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebfd3102bbf44882bd3640a7ca6078a2', 'request_id': 'req-df16d368-095e-4931-95ca-fd0b739b44e5'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:28.857724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebfd3102bbf44882bd3640a7ca6078a2', 'request_id': 'req-df16d368-095e-4931-95ca-fd0b739b44e5'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:28.868189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] The token cache is being invalidate because project ebfd3102bbf44882bd3640a7ca6078a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:28.868477 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:28.869127 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:28.870921 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1319/2655] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:28 2022] DELETE /identity/v3/projects/ebfd3102bbf44882bd3640a7ca6078a2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:28.876210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478ff31-571a-4912-81de-21a1f58814d0 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:28.886878 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478ff31-571a-4912-81de-21a1f58814d0 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:28.962482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a344785-2b7c-46c9-a7f6-ccfe26bdb607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:28.963453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a344785-2b7c-46c9-a7f6-ccfe26bdb607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:28.963740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a344785-2b7c-46c9-a7f6-ccfe26bdb607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:28.964025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a344785-2b7c-46c9-a7f6-ccfe26bdb607 admin admin] PATH_INFO: `/v3/users/6fd80a70eb7b4a6681837255be5110c5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:28.965662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a344785-2b7c-46c9-a7f6-ccfe26bdb607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd80a70eb7b4a6681837255be5110c5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:28.967641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a344785-2b7c-46c9-a7f6-ccfe26bdb607 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:29.029537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1a344785-2b7c-46c9-a7f6-ccfe26bdb607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd80a70eb7b4a6681837255be5110c5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:29.030916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1a344785-2b7c-46c9-a7f6-ccfe26bdb607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd80a70eb7b4a6681837255be5110c5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:29.031536 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1a344785-2b7c-46c9-a7f6-ccfe26bdb607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd80a70eb7b4a6681837255be5110c5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:29.040226 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1a344785-2b7c-46c9-a7f6-ccfe26bdb607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd80a70eb7b4a6681837255be5110c5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:29.059510 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1a344785-2b7c-46c9-a7f6-ccfe26bdb607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd80a70eb7b4a6681837255be5110c5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:29.080801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1337/2656] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:28 2022] DELETE /identity/v3/users/6fd80a70eb7b4a6681837255be5110c5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:29.410467 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:29.412060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:29.425407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16d368-095e-4931-95ca-fd0b739b44e5 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:29.460780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:29.488377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:29.489252 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:29.489534 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:29.489809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] PATH_INFO: `/v3/projects/84db7aeb6e1e4cbba4bcdcab178ecaae` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:29.491041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=84db7aeb6e1e4cbba4bcdcab178ecaae)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:29.492954 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:29.566246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84db7aeb6e1e4cbba4bcdcab178ecaae', 'request_id': 'req-ea08d848-05f2-4fbb-b205-3076ca709c9e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:29.579456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84db7aeb6e1e4cbba4bcdcab178ecaae', 'request_id': 'req-ea08d848-05f2-4fbb-b205-3076ca709c9e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:29.589521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84db7aeb6e1e4cbba4bcdcab178ecaae', 'request_id': 'req-ea08d848-05f2-4fbb-b205-3076ca709c9e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:29.601863 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] The token cache is being invalidate because project 84db7aeb6e1e4cbba4bcdcab178ecaae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:29.602558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:29.603410 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ea08d848-05f2-4fbb-b205-3076ca709c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:29.605347 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1320/2657] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:29 2022] DELETE /identity/v3/projects/84db7aeb6e1e4cbba4bcdcab178ecaae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:29.610897 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0111-952b-4019-94e2-b7fc4c4f0b3f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:29.611756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0111-952b-4019-94e2-b7fc4c4f0b3f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:29.611756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0111-952b-4019-94e2-b7fc4c4f0b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:29.638072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-928f0111-952b-4019-94e2-b7fc4c4f0b3f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:29.639490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-928f0111-952b-4019-94e2-b7fc4c4f0b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:29.648519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:29.732887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1338/2658] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:08:29.740479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18645e-007b-4b2d-90d6-a68521dbbad4 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:29.740775 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18645e-007b-4b2d-90d6-a68521dbbad4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:29.741056 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18645e-007b-4b2d-90d6-a68521dbbad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:29.761433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5e18645e-007b-4b2d-90d6-a68521dbbad4 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:29.763445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5e18645e-007b-4b2d-90d6-a68521dbbad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:29.771720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1321/2659] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:29.776242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f0111-952b-4019-94e2-b7fc4c4f0b3f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:29.786767 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f0111-952b-4019-94e2-b7fc4c4f0b3f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:29.791316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda828-b41d-44a7-a2f0-60e2da00e5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:29.791975 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda828-b41d-44a7-a2f0-60e2da00e5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:29.792258 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda828-b41d-44a7-a2f0-60e2da00e5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:29.792532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda828-b41d-44a7-a2f0-60e2da00e5f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:29.793338 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bda828-b41d-44a7-a2f0-60e2da00e5f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:08:29.793644 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bda828-b41d-44a7-a2f0-60e2da00e5f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:29.795279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bda828-b41d-44a7-a2f0-60e2da00e5f9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:29.808601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1339/2660] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:08:29.813153 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18645e-007b-4b2d-90d6-a68521dbbad4 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:29.823019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18645e-007b-4b2d-90d6-a68521dbbad4 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:29.828958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8633e64-a2df-4d54-9bb1-3b19ae8d9a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:29.829630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633e64-a2df-4d54-9bb1-3b19ae8d9a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:29.829953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633e64-a2df-4d54-9bb1-3b19ae8d9a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:29.830234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633e64-a2df-4d54-9bb1-3b19ae8d9a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:29.831058 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8633e64-a2df-4d54-9bb1-3b19ae8d9a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:29.832821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8633e64-a2df-4d54-9bb1-3b19ae8d9a26 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:29.861194 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1322/2661] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:29 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:29.868662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda828-b41d-44a7-a2f0-60e2da00e5f9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:29.876676 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda828-b41d-44a7-a2f0-60e2da00e5f9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:29.946414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627aac0-4e8f-40fb-abd7-cae5cae5f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:29.947008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627aac0-4e8f-40fb-abd7-cae5cae5f8fa admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:29.947324 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627aac0-4e8f-40fb-abd7-cae5cae5f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:29.947593 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627aac0-4e8f-40fb-abd7-cae5cae5f8fa admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:29.948296 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627aac0-4e8f-40fb-abd7-cae5cae5f8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:29.951013 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627aac0-4e8f-40fb-abd7-cae5cae5f8fa admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:29.982231 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1340/2662] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:29 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:29.986746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8633e64-a2df-4d54-9bb1-3b19ae8d9a26 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:30.007825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8633e64-a2df-4d54-9bb1-3b19ae8d9a26 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:30.013362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f8b7e-f151-46a8-9886-e0f206a7541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:30.014401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f8b7e-f151-46a8-9886-e0f206a7541e admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:30.014791 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f8b7e-f151-46a8-9886-e0f206a7541e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:30.015249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f8b7e-f151-46a8-9886-e0f206a7541e admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:30.016087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f8b7e-f151-46a8-9886-e0f206a7541e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:30.018158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f8b7e-f151-46a8-9886-e0f206a7541e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:30.042510 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1323/2663] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:08:30.042655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627aac0-4e8f-40fb-abd7-cae5cae5f8fa admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:30.052513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627aac0-4e8f-40fb-abd7-cae5cae5f8fa admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:30.057254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc742213-037f-4da8-922b-fcd1713f46a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:30.057954 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc742213-037f-4da8-922b-fcd1713f46a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:30.058235 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc742213-037f-4da8-922b-fcd1713f46a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:30.058508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc742213-037f-4da8-922b-fcd1713f46a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:30.059487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc742213-037f-4da8-922b-fcd1713f46a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:30.061294 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc742213-037f-4da8-922b-fcd1713f46a4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:30.072327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1341/2664] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:30.077727 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f8b7e-f151-46a8-9886-e0f206a7541e admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:30.088143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f8b7e-f151-46a8-9886-e0f206a7541e admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:30.094369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67d5a0-e26a-4dcb-99ec-e22ad43417dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:30.095260 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d5a0-e26a-4dcb-99ec-e22ad43417dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:30.095540 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d5a0-e26a-4dcb-99ec-e22ad43417dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:30.095811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d5a0-e26a-4dcb-99ec-e22ad43417dc admin admin] PATH_INFO: `/v3/projects/d01b8f20adb2434fa4bf36a32620ac2d/users/a22d415c98084887bb9e665b672524da/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:30.111348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67d5a0-e26a-4dcb-99ec-e22ad43417dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01b8f20adb2434fa4bf36a32620ac2d, user_id=a22d415c98084887bb9e665b672524da, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:30.114015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67d5a0-e26a-4dcb-99ec-e22ad43417dc admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:30.129677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1324/2665] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:30 2022] PUT /identity/v3/projects/d01b8f20adb2434fa4bf36a32620ac2d/users/a22d415c98084887bb9e665b672524da/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:30.141557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d679ba8-754f-4dc6-9ae2-3a58b42d0f05 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:30.141861 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d679ba8-754f-4dc6-9ae2-3a58b42d0f05 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:30.142183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d679ba8-754f-4dc6-9ae2-3a58b42d0f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:30.168912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7d679ba8-754f-4dc6-9ae2-3a58b42d0f05 None None] MFA Rules not processed for user `a22d415c98084887bb9e665b672524da`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:30.170175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7d679ba8-754f-4dc6-9ae2-3a58b42d0f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:30.236905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1342/2666] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:30.241938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67d5a0-e26a-4dcb-99ec-e22ad43417dc admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:30.312543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67d5a0-e26a-4dcb-99ec-e22ad43417dc admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:30.317257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e1188-a2d4-42cd-be4b-91aa18e9c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:30.317947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1188-a2d4-42cd-be4b-91aa18e9c656 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:30.318229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1188-a2d4-42cd-be4b-91aa18e9c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:30.318670 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1188-a2d4-42cd-be4b-91aa18e9c656 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:30.319214 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e1188-a2d4-42cd-be4b-91aa18e9c656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:30.321087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e1188-a2d4-42cd-be4b-91aa18e9c656 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:30.326452 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:30.355819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1325/2667] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:30 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:30.360994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d679ba8-754f-4dc6-9ae2-3a58b42d0f05 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:30.377641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d679ba8-754f-4dc6-9ae2-3a58b42d0f05 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:30.392473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:30.483947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095016e-2e1c-4af0-afb1-e7c01bc7c7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:30.484792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095016e-2e1c-4af0-afb1-e7c01bc7c7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:30.485085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095016e-2e1c-4af0-afb1-e7c01bc7c7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:30.485389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095016e-2e1c-4af0-afb1-e7c01bc7c7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:30.486652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095016e-2e1c-4af0-afb1-e7c01bc7c7e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:30.488199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095016e-2e1c-4af0-afb1-e7c01bc7c7e4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:30.512974 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1343/2668] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:30 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:08:30.517403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e1188-a2d4-42cd-be4b-91aa18e9c656 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:30.530635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e1188-a2d4-42cd-be4b-91aa18e9c656 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:30.535784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e665604-66d4-4992-93c0-07289bbb0773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:30.536503 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e665604-66d4-4992-93c0-07289bbb0773 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:30.536794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e665604-66d4-4992-93c0-07289bbb0773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:30.537073 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e665604-66d4-4992-93c0-07289bbb0773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:30.537835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e665604-66d4-4992-93c0-07289bbb0773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:30.539471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e665604-66d4-4992-93c0-07289bbb0773 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:30.552097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1326/2669] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:08:30.556750 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095016e-2e1c-4af0-afb1-e7c01bc7c7e4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:30.568928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095016e-2e1c-4af0-afb1-e7c01bc7c7e4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:30.574091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9dd15-8c58-4711-8203-e37849444b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:30.575157 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9dd15-8c58-4711-8203-e37849444b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:30.575444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9dd15-8c58-4711-8203-e37849444b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:30.575725 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9dd15-8c58-4711-8203-e37849444b3b admin admin] PATH_INFO: `/v3/projects/1c7321a01c004ca8af3a74470bbeee19/users/7dd9950de5c44531b88b0868a8ff2aaa/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:30.599828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9dd15-8c58-4711-8203-e37849444b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7321a01c004ca8af3a74470bbeee19, user_id=7dd9950de5c44531b88b0868a8ff2aaa, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:30.602572 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9dd15-8c58-4711-8203-e37849444b3b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:30.618734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1344/2670] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:30 2022] PUT /identity/v3/projects/1c7321a01c004ca8af3a74470bbeee19/users/7dd9950de5c44531b88b0868a8ff2aaa/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:30.624552 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e665604-66d4-4992-93c0-07289bbb0773 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:30.635550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e665604-66d4-4992-93c0-07289bbb0773 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:30.702630 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0775f0-59eb-4c79-ae19-2563bdeb77d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:30.703401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0775f0-59eb-4c79-ae19-2563bdeb77d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:30.703769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0775f0-59eb-4c79-ae19-2563bdeb77d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:30.704101 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0775f0-59eb-4c79-ae19-2563bdeb77d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:30.705034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0775f0-59eb-4c79-ae19-2563bdeb77d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:30.706905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0775f0-59eb-4c79-ae19-2563bdeb77d9 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:30.737381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1327/2671] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:30.739110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9dd15-8c58-4711-8203-e37849444b3b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:30.765321 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9dd15-8c58-4711-8203-e37849444b3b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:30.770528 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8e389-2051-4b8b-bf3e-c936404b8eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:30.771445 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8e389-2051-4b8b-bf3e-c936404b8eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:30.771724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8e389-2051-4b8b-bf3e-c936404b8eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:30.772002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8e389-2051-4b8b-bf3e-c936404b8eb8 admin admin] PATH_INFO: `/v3/projects/1c7321a01c004ca8af3a74470bbeee19/users/7dd9950de5c44531b88b0868a8ff2aaa/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:30.775735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8e389-2051-4b8b-bf3e-c936404b8eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7321a01c004ca8af3a74470bbeee19, user_id=7dd9950de5c44531b88b0868a8ff2aaa, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:30.780696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8e389-2051-4b8b-bf3e-c936404b8eb8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:30.792811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1345/2672] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:30 2022] PUT /identity/v3/projects/1c7321a01c004ca8af3a74470bbeee19/users/7dd9950de5c44531b88b0868a8ff2aaa/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:30.805851 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1200b-74b1-4db2-a570-14459fcbfb0d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:30.806552 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1200b-74b1-4db2-a570-14459fcbfb0d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:30.806835 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1200b-74b1-4db2-a570-14459fcbfb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:30.853047 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5bb1200b-74b1-4db2-a570-14459fcbfb0d None None] MFA Rules not processed for user `7dd9950de5c44531b88b0868a8ff2aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:30.854563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5bb1200b-74b1-4db2-a570-14459fcbfb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:30.968963 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1328/2673] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:30.980309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8e389-2051-4b8b-bf3e-c936404b8eb8 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:30.983073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cdd8e389-2051-4b8b-bf3e-c936404b8eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:31.068311 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8e389-2051-4b8b-bf3e-c936404b8eb8 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:31.072517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b802b-1e5c-4f4a-a3d0-841f191ceb92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:31.073226 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b802b-1e5c-4f4a-a3d0-841f191ceb92 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:31.073453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b802b-1e5c-4f4a-a3d0-841f191ceb92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:31.074018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b802b-1e5c-4f4a-a3d0-841f191ceb92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:31.084556 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b802b-1e5c-4f4a-a3d0-841f191ceb92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:31.086029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b802b-1e5c-4f4a-a3d0-841f191ceb92 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:31.100540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1346/2674] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:31.181535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1200b-74b1-4db2-a570-14459fcbfb0d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:31.194859 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1200b-74b1-4db2-a570-14459fcbfb0d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:31.200511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a7ac1-a38b-4eac-aaa4-4fee69ea980c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:31.201527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a7ac1-a38b-4eac-aaa4-4fee69ea980c service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:31.202003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a7ac1-a38b-4eac-aaa4-4fee69ea980c service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:31.202446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a7ac1-a38b-4eac-aaa4-4fee69ea980c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:31.262623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:31.266193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a7ac1-a38b-4eac-aaa4-4fee69ea980c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:31.267878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a7ac1-a38b-4eac-aaa4-4fee69ea980c service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:31.279503 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1329/2675] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:32.026454 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b802b-1e5c-4f4a-a3d0-841f191ceb92 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:32.029668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6d4b802b-1e5c-4f4a-a3d0-841f191ceb92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:32.146498 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:32.188817 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b802b-1e5c-4f4a-a3d0-841f191ceb92 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:32.196343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5db14-a3b3-41e7-b2d3-ba9f7b860c31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:32.197017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5db14-a3b3-41e7-b2d3-ba9f7b860c31 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:32.197302 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5db14-a3b3-41e7-b2d3-ba9f7b860c31 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:32.197577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5db14-a3b3-41e7-b2d3-ba9f7b860c31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:32.199924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-71c5db14-a3b3-41e7-b2d3-ba9f7b860c31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:32.213221 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5db14-a3b3-41e7-b2d3-ba9f7b860c31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:32.215715 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5db14-a3b3-41e7-b2d3-ba9f7b860c31 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:32.226603 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1347/2676] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:32.263086 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a7ac1-a38b-4eac-aaa4-4fee69ea980c service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:32.264788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-cc2a7ac1-a38b-4eac-aaa4-4fee69ea980c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:32.342768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a7ac1-a38b-4eac-aaa4-4fee69ea980c service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:32.347588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:32.348481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:32.348834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:32.349117 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] PATH_INFO: `/v3/users/2eb8e7ee469d426388e4cba3f6830f3b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:32.350358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb8e7ee469d426388e4cba3f6830f3b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:32.352284 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:32.411782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb8e7ee469d426388e4cba3f6830f3b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:32.423915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb8e7ee469d426388e4cba3f6830f3b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:32.447919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb8e7ee469d426388e4cba3f6830f3b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:32.449149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb8e7ee469d426388e4cba3f6830f3b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:32.472216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb8e7ee469d426388e4cba3f6830f3b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:32.483904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1330/2677] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:32 2022] DELETE /identity/v3/users/2eb8e7ee469d426388e4cba3f6830f3b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:32.716304 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5db14-a3b3-41e7-b2d3-ba9f7b860c31 service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:32.732544 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5db14-a3b3-41e7-b2d3-ba9f7b860c31 service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:32.846429 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:32.847365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:32.847647 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:32.847920 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] PATH_INFO: `/v3/projects/bd163ce773a149819901625613570fcf` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:32.849190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd163ce773a149819901625613570fcf)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:32.851181 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:32.921131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd163ce773a149819901625613570fcf', 'request_id': 'req-79989728-5ae2-42cc-b7b4-6d56498382c6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:32.952298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd163ce773a149819901625613570fcf', 'request_id': 'req-79989728-5ae2-42cc-b7b4-6d56498382c6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:32.977855 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd163ce773a149819901625613570fcf', 'request_id': 'req-79989728-5ae2-42cc-b7b4-6d56498382c6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:32.995318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] The token cache is being invalidate because project bd163ce773a149819901625613570fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:32.995828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:32.997559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:33.012435 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1348/2678] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:32 2022] DELETE /identity/v3/projects/bd163ce773a149819901625613570fcf => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:36.292209 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:36.294404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:36.352811 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df5e86-4451-4569-bd41-d3c60b4d5c07 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:36.388176 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:36.416946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9724c-5512-4a49-84a5-c284dba215ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:36.417661 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9724c-5512-4a49-84a5-c284dba215ee service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:36.418008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9724c-5512-4a49-84a5-c284dba215ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:36.419097 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9724c-5512-4a49-84a5-c284dba215ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:36.421006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-cbd9724c-5512-4a49-84a5-c284dba215ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:36.490115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9724c-5512-4a49-84a5-c284dba215ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:36.491472 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9724c-5512-4a49-84a5-c284dba215ee service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:36.502066 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1331/2679] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:38.513779 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:38.515173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:38.530298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79989728-5ae2-42cc-b7b4-6d56498382c6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:38.536684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:38.537771 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:38.538317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:38.538773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] PATH_INFO: `/v3/users/a22d415c98084887bb9e665b672524da` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:38.540128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22d415c98084887bb9e665b672524da)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:38.542092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:38.635764 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22d415c98084887bb9e665b672524da'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:38.636438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22d415c98084887bb9e665b672524da'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:38.637580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22d415c98084887bb9e665b672524da'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:38.648034 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22d415c98084887bb9e665b672524da'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:38.651262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:38.672655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22d415c98084887bb9e665b672524da'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:38.703073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1349/2680] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:38 2022] DELETE /identity/v3/users/a22d415c98084887bb9e665b672524da => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:38.704485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59119-2cd0-47aa-9fba-86a3194cdffd None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:38.704968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59119-2cd0-47aa-9fba-86a3194cdffd None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:38.705081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59119-2cd0-47aa-9fba-86a3194cdffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:38.731241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4fa59119-2cd0-47aa-9fba-86a3194cdffd None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:38.734108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4fa59119-2cd0-47aa-9fba-86a3194cdffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:38.832930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1332/2681] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:38.847125 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:38.849809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:38.951848 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663e326-2949-480a-b1f8-5c837e9ab63f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:38.956422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6068ea0-6404-4026-9a28-38ec086542fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:38.957342 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6068ea0-6404-4026-9a28-38ec086542fe service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:38.957703 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6068ea0-6404-4026-9a28-38ec086542fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:38.958094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6068ea0-6404-4026-9a28-38ec086542fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:38.974224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6068ea0-6404-4026-9a28-38ec086542fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:38.976076 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6068ea0-6404-4026-9a28-38ec086542fe service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:38.989352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1350/2682] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:39.570763 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa59119-2cd0-47aa-9fba-86a3194cdffd None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:39.572299 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4fa59119-2cd0-47aa-9fba-86a3194cdffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:39.596698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa59119-2cd0-47aa-9fba-86a3194cdffd None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:39.611840 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:39.612941 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:39.613258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:39.613545 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] PATH_INFO: `/v3/projects/d01b8f20adb2434fa4bf36a32620ac2d` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:39.615131 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d01b8f20adb2434fa4bf36a32620ac2d)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:39.617285 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:39.691985 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd01b8f20adb2434fa4bf36a32620ac2d', 'request_id': 'req-c05d5737-54b4-45e5-9063-0555535a65c1'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:39.702707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd01b8f20adb2434fa4bf36a32620ac2d', 'request_id': 'req-c05d5737-54b4-45e5-9063-0555535a65c1'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:39.710528 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd01b8f20adb2434fa4bf36a32620ac2d', 'request_id': 'req-c05d5737-54b4-45e5-9063-0555535a65c1'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:39.725681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] The token cache is being invalidate because project d01b8f20adb2434fa4bf36a32620ac2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:39.726057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:39.726712 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:39.728655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1333/2683] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:39 2022] DELETE /identity/v3/projects/d01b8f20adb2434fa4bf36a32620ac2d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:39.734850 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6068ea0-6404-4026-9a28-38ec086542fe service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:39.751262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6068ea0-6404-4026-9a28-38ec086542fe service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:39.848540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:39.849684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:39.850040 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:39.850387 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] PATH_INFO: `/v3/users/7dd9950de5c44531b88b0868a8ff2aaa` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:39.851733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd9950de5c44531b88b0868a8ff2aaa)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:39.853673 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:39.926778 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd9950de5c44531b88b0868a8ff2aaa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:39.927519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd9950de5c44531b88b0868a8ff2aaa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:39.928151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd9950de5c44531b88b0868a8ff2aaa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:39.938766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd9950de5c44531b88b0868a8ff2aaa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:39.951564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd9950de5c44531b88b0868a8ff2aaa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:39.970090 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:39.976392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1351/2684] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:39 2022] DELETE /identity/v3/users/7dd9950de5c44531b88b0868a8ff2aaa => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:40.580317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:40.581297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:40.589001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:40.646444 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:40.647940 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:40.705318 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d5737-54b4-45e5-9063-0555535a65c1 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:40.744167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0034c0-e4f3-429c-a833-9e82139e595c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:40.752476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc85ab-0b5c-4111-96ce-79307fd83ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:40.753591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc85ab-0b5c-4111-96ce-79307fd83ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:40.753984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc85ab-0b5c-4111-96ce-79307fd83ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:40.756433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc85ab-0b5c-4111-96ce-79307fd83ec4 admin admin] PATH_INFO: `/v3/users/765e8ba07bc1465fa3ce3444d05ad36b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:40.765240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc85ab-0b5c-4111-96ce-79307fd83ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765e8ba07bc1465fa3ce3444d05ad36b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:40.773055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc85ab-0b5c-4111-96ce-79307fd83ec4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:40.813581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab242c-15ab-4439-ab69-af014f5201cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:40.814305 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab242c-15ab-4439-ab69-af014f5201cf service placement] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:40.814619 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab242c-15ab-4439-ab69-af014f5201cf service placement] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:40.814868 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab242c-15ab-4439-ab69-af014f5201cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:40.817302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-aeab242c-15ab-4439-ab69-af014f5201cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:40.839543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab242c-15ab-4439-ab69-af014f5201cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:40.841517 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab242c-15ab-4439-ab69-af014f5201cf service placement] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:40.848756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-94dc85ab-0b5c-4111-96ce-79307fd83ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765e8ba07bc1465fa3ce3444d05ad36b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:40.850357 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-94dc85ab-0b5c-4111-96ce-79307fd83ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765e8ba07bc1465fa3ce3444d05ad36b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:40.851167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-94dc85ab-0b5c-4111-96ce-79307fd83ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765e8ba07bc1465fa3ce3444d05ad36b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:40.857155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1334/2685] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:40.857863 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab242c-15ab-4439-ab69-af014f5201cf service placement] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:40.862541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-aeab242c-15ab-4439-ab69-af014f5201cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:40.868991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-94dc85ab-0b5c-4111-96ce-79307fd83ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765e8ba07bc1465fa3ce3444d05ad36b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:40.880856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-94dc85ab-0b5c-4111-96ce-79307fd83ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765e8ba07bc1465fa3ce3444d05ad36b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:40.892432 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab242c-15ab-4439-ab69-af014f5201cf service placement] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:40.899956 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:40.900907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:40.901188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:40.901466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] PATH_INFO: `/v3/projects/1c7321a01c004ca8af3a74470bbeee19` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:40.903563 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c7321a01c004ca8af3a74470bbeee19)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:40.905445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:40.913930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1352/2686] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:40 2022] DELETE /identity/v3/users/765e8ba07bc1465fa3ce3444d05ad36b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:40.959217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7321a01c004ca8af3a74470bbeee19', 'request_id': 'req-0c6fe394-bb74-40b3-bc69-9a041f997105'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:40.969750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7321a01c004ca8af3a74470bbeee19', 'request_id': 'req-0c6fe394-bb74-40b3-bc69-9a041f997105'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:40.976897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7321a01c004ca8af3a74470bbeee19', 'request_id': 'req-0c6fe394-bb74-40b3-bc69-9a041f997105'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:40.988204 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] The token cache is being invalidate because project 1c7321a01c004ca8af3a74470bbeee19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:40.988499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:40.989190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:40.990821 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1335/2687] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:40 2022] DELETE /identity/v3/projects/1c7321a01c004ca8af3a74470bbeee19 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:40.999105 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3e6c-0cfb-4530-8244-ab5ad6a35e2e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:40.999413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3e6c-0cfb-4530-8244-ab5ad6a35e2e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:40.999659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3e6c-0cfb-4530-8244-ab5ad6a35e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.019949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cdfc3e6c-0cfb-4530-8244-ab5ad6a35e2e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:41.021264 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cdfc3e6c-0cfb-4530-8244-ab5ad6a35e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:41.102376 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1353/2688] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:08:41.109440 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.113476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:41.115022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49b9f6-7872-4197-99a4-f03382e5314c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.115408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49b9f6-7872-4197-99a4-f03382e5314c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.115854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49b9f6-7872-4197-99a4-f03382e5314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.142321 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fe49b9f6-7872-4197-99a4-f03382e5314c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:41.143620 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fe49b9f6-7872-4197-99a4-f03382e5314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:41.143888 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe394-bb74-40b3-bc69-9a041f997105 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.150000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.150887 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.151174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.151606 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] PATH_INFO: `/v3/projects/ea2cd423f876438e88c98b4a2405834a` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.153765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2cd423f876438e88c98b4a2405834a)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.160713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1354/2689] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:08:41.160918 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.161914 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49b9f6-7872-4197-99a4-f03382e5314c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.173524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49b9f6-7872-4197-99a4-f03382e5314c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.174669 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:41.179538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2dbee-4d2c-4bcd-80a0-fd1861102c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.180217 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2dbee-4d2c-4bcd-80a0-fd1861102c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.181008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2dbee-4d2c-4bcd-80a0-fd1861102c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.181293 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2dbee-4d2c-4bcd-80a0-fd1861102c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.182121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2dbee-4d2c-4bcd-80a0-fd1861102c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:08:41.182848 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2dbee-4d2c-4bcd-80a0-fd1861102c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.185228 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2dbee-4d2c-4bcd-80a0-fd1861102c20 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.192932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:41.199549 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1355/2690] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:08:41.204514 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2dbee-4d2c-4bcd-80a0-fd1861102c20 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.214025 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2cd423f876438e88c98b4a2405834a', 'request_id': 'req-78066d01-eb06-4c28-be87-a7aaacdf7666'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:41.217158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2dbee-4d2c-4bcd-80a0-fd1861102c20 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.223916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2cd423f876438e88c98b4a2405834a', 'request_id': 'req-78066d01-eb06-4c28-be87-a7aaacdf7666'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:41.231306 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2cd423f876438e88c98b4a2405834a', 'request_id': 'req-78066d01-eb06-4c28-be87-a7aaacdf7666'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:41.247278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] The token cache is being invalidate because project ea2cd423f876438e88c98b4a2405834a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:41.247278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:41.247278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-78066d01-eb06-4c28-be87-a7aaacdf7666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:41.247278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1336/2691] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:41 2022] DELETE /identity/v3/projects/ea2cd423f876438e88c98b4a2405834a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:41.251823 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b3112-3fa5-446b-862d-93f0ace0dced None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.252180 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b3112-3fa5-446b-862d-93f0ace0dced None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.252523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b3112-3fa5-446b-862d-93f0ace0dced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.272384 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-705b3112-3fa5-446b-862d-93f0ace0dced None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:41.273510 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-705b3112-3fa5-446b-862d-93f0ace0dced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:41.288056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a9889-e4ee-4b46-8a2c-fdb091f04e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.288717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a9889-e4ee-4b46-8a2c-fdb091f04e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.289002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a9889-e4ee-4b46-8a2c-fdb091f04e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.289283 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a9889-e4ee-4b46-8a2c-fdb091f04e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.289998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a9889-e4ee-4b46-8a2c-fdb091f04e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.291912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a9889-e4ee-4b46-8a2c-fdb091f04e38 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.325946 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1356/2692] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:41 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:41.327403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a9889-e4ee-4b46-8a2c-fdb091f04e38 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.329146 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ac3a9889-e4ee-4b46-8a2c-fdb091f04e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:41.342062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1337/2693] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:41.350143 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789707-fc41-45d5-a39a-f689c6470b83 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.350441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789707-fc41-45d5-a39a-f689c6470b83 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.350724 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789707-fc41-45d5-a39a-f689c6470b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.369632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-48789707-fc41-45d5-a39a-f689c6470b83 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:41.371777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-48789707-fc41-45d5-a39a-f689c6470b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:41.399138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a9889-e4ee-4b46-8a2c-fdb091f04e38 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.404097 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f09162-944c-4a41-b185-585d91ee0616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.404773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09162-944c-4a41-b185-585d91ee0616 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.405052 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09162-944c-4a41-b185-585d91ee0616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.405325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09162-944c-4a41-b185-585d91ee0616 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.406056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f09162-944c-4a41-b185-585d91ee0616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.408027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f09162-944c-4a41-b185-585d91ee0616 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.428947 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1357/2694] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:41 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:41.434158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f09162-944c-4a41-b185-585d91ee0616 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.444457 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1338/2695] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:08:41.446022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f09162-944c-4a41-b185-585d91ee0616 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.449003 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48789707-fc41-45d5-a39a-f689c6470b83 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.453466 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209335f-56a7-4c28-a87d-6ff3ecff90e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.454282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209335f-56a7-4c28-a87d-6ff3ecff90e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.454568 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209335f-56a7-4c28-a87d-6ff3ecff90e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.454844 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209335f-56a7-4c28-a87d-6ff3ecff90e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.455574 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209335f-56a7-4c28-a87d-6ff3ecff90e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.457348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209335f-56a7-4c28-a87d-6ff3ecff90e6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.459650 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48789707-fc41-45d5-a39a-f689c6470b83 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.464511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd18bc-af1a-426b-974d-eb44a944294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.465436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd18bc-af1a-426b-974d-eb44a944294c admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.466278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd18bc-af1a-426b-974d-eb44a944294c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.466278 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd18bc-af1a-426b-974d-eb44a944294c admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.466814 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd18bc-af1a-426b-974d-eb44a944294c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:08:41.467120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd18bc-af1a-426b-974d-eb44a944294c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.468716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd18bc-af1a-426b-974d-eb44a944294c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.474313 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1358/2696] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:08:41.478074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209335f-56a7-4c28-a87d-6ff3ecff90e6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.481837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1339/2697] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:08:41.487718 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd18bc-af1a-426b-974d-eb44a944294c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.490279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209335f-56a7-4c28-a87d-6ff3ecff90e6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.496839 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814f20b-075d-4dd5-beef-28fdb5c0b736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.497524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814f20b-075d-4dd5-beef-28fdb5c0b736 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.497835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814f20b-075d-4dd5-beef-28fdb5c0b736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.498154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814f20b-075d-4dd5-beef-28fdb5c0b736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.498779 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd18bc-af1a-426b-974d-eb44a944294c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.498901 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814f20b-075d-4dd5-beef-28fdb5c0b736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.500499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814f20b-075d-4dd5-beef-28fdb5c0b736 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.503551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95e6d-71d5-471a-b9d2-0a575ef0cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.504212 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95e6d-71d5-471a-b9d2-0a575ef0cd97 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.504496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95e6d-71d5-471a-b9d2-0a575ef0cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.504769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95e6d-71d5-471a-b9d2-0a575ef0cd97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.505456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf95e6d-71d5-471a-b9d2-0a575ef0cd97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.507622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf95e6d-71d5-471a-b9d2-0a575ef0cd97 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.512641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1359/2698] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:41.516467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814f20b-075d-4dd5-beef-28fdb5c0b736 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.526671 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814f20b-075d-4dd5-beef-28fdb5c0b736 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.531571 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0431c-3ac6-4b35-891f-db1facc28907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.532513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0431c-3ac6-4b35-891f-db1facc28907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.532745 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0431c-3ac6-4b35-891f-db1facc28907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.533019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0431c-3ac6-4b35-891f-db1facc28907 admin admin] PATH_INFO: `/v3/projects/6e7ba23e50974fa696dea3dc77a59566/users/b514cfa716be429bbc7835b9d167bbb0/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.541237 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1340/2699] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:41 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:41.545353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95e6d-71d5-471a-b9d2-0a575ef0cd97 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.550961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0431c-3ac6-4b35-891f-db1facc28907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7ba23e50974fa696dea3dc77a59566, user_id=b514cfa716be429bbc7835b9d167bbb0, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.554204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0431c-3ac6-4b35-891f-db1facc28907 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.556340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:41.571045 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1360/2700] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:41 2022] PUT /identity/v3/projects/6e7ba23e50974fa696dea3dc77a59566/users/b514cfa716be429bbc7835b9d167bbb0/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:41.583566 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c21d4-8393-476a-bc84-1624d1541ddb None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.583999 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c21d4-8393-476a-bc84-1624d1541ddb None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.584360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c21d4-8393-476a-bc84-1624d1541ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.612467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b04c21d4-8393-476a-bc84-1624d1541ddb None None] MFA Rules not processed for user `b514cfa716be429bbc7835b9d167bbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:41.613691 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b04c21d4-8393-476a-bc84-1624d1541ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:41.615559 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95e6d-71d5-471a-b9d2-0a575ef0cd97 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.628393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:41.684653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad6c63-ee56-4a27-a272-5114b7d19a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.685529 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad6c63-ee56-4a27-a272-5114b7d19a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.685813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad6c63-ee56-4a27-a272-5114b7d19a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.686121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad6c63-ee56-4a27-a272-5114b7d19a2f admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.686816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad6c63-ee56-4a27-a272-5114b7d19a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.688746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad6c63-ee56-4a27-a272-5114b7d19a2f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.692543 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1361/2701] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:41.693556 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c21d4-8393-476a-bc84-1624d1541ddb None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.706072 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c21d4-8393-476a-bc84-1624d1541ddb None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.711373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa832c-e8e3-4eae-9647-2e259407e83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.712127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa832c-e8e3-4eae-9647-2e259407e83a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.712482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa832c-e8e3-4eae-9647-2e259407e83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.713110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa832c-e8e3-4eae-9647-2e259407e83a admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.715690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa832c-e8e3-4eae-9647-2e259407e83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.720055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa832c-e8e3-4eae-9647-2e259407e83a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.722018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1341/2702] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:41 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:08:41.727521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad6c63-ee56-4a27-a272-5114b7d19a2f admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.739794 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad6c63-ee56-4a27-a272-5114b7d19a2f admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.744665 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d875a0b-c051-464c-899a-ad9cd2bfc04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.746836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d875a0b-c051-464c-899a-ad9cd2bfc04e admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.747241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d875a0b-c051-464c-899a-ad9cd2bfc04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.747629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d875a0b-c051-464c-899a-ad9cd2bfc04e admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.748364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d875a0b-c051-464c-899a-ad9cd2bfc04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.750017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d875a0b-c051-464c-899a-ad9cd2bfc04e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.761307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1342/2703] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:41.765387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d875a0b-c051-464c-899a-ad9cd2bfc04e admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.766441 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1362/2704] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:41 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:41.770252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa832c-e8e3-4eae-9647-2e259407e83a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.776021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d875a0b-c051-464c-899a-ad9cd2bfc04e admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.843967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa832c-e8e3-4eae-9647-2e259407e83a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.844846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4d6ce-63d8-4b67-926b-9138b2ef38b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.845617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4d6ce-63d8-4b67-926b-9138b2ef38b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.845998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4d6ce-63d8-4b67-926b-9138b2ef38b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.846343 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4d6ce-63d8-4b67-926b-9138b2ef38b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.847139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4d6ce-63d8-4b67-926b-9138b2ef38b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.848869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4d6ce-63d8-4b67-926b-9138b2ef38b0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.849537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80738f6-84b3-4085-8fa7-3a316ca850a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.850521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80738f6-84b3-4085-8fa7-3a316ca850a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.850655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80738f6-84b3-4085-8fa7-3a316ca850a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.850899 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80738f6-84b3-4085-8fa7-3a316ca850a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.851604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80738f6-84b3-4085-8fa7-3a316ca850a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.853688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80738f6-84b3-4085-8fa7-3a316ca850a0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.860772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1343/2705] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:08:41.864873 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4d6ce-63d8-4b67-926b-9138b2ef38b0 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.875986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4d6ce-63d8-4b67-926b-9138b2ef38b0 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.876366 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1363/2706] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:41 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:08:41.880268 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80738f6-84b3-4085-8fa7-3a316ca850a0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.882926 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511d80a-29f8-4168-8080-ad9b9aab9050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.883830 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511d80a-29f8-4168-8080-ad9b9aab9050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.884115 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511d80a-29f8-4168-8080-ad9b9aab9050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.884390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511d80a-29f8-4168-8080-ad9b9aab9050 admin admin] PATH_INFO: `/v3/projects/140c707eb5404b8a8d0348b4ee6199d3/users/cc01a035416845baa8c7abbcfaa20cfa/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.892450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80738f6-84b3-4085-8fa7-3a316ca850a0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.897152 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca50076-de92-4a53-b833-21dd125025ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:41.897854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca50076-de92-4a53-b833-21dd125025ef admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.898162 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca50076-de92-4a53-b833-21dd125025ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.898434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca50076-de92-4a53-b833-21dd125025ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.899156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca50076-de92-4a53-b833-21dd125025ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.900955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca50076-de92-4a53-b833-21dd125025ef admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.903776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511d80a-29f8-4168-8080-ad9b9aab9050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=140c707eb5404b8a8d0348b4ee6199d3, user_id=cc01a035416845baa8c7abbcfaa20cfa, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:41.908024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511d80a-29f8-4168-8080-ad9b9aab9050 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:41.915558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1364/2707] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:08:41.920245 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca50076-de92-4a53-b833-21dd125025ef admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:41.928280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1344/2708] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:41 2022] PUT /identity/v3/projects/140c707eb5404b8a8d0348b4ee6199d3/users/cc01a035416845baa8c7abbcfaa20cfa/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:41.937481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca50076-de92-4a53-b833-21dd125025ef admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:41.938964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7250a5b-cbac-4557-b6de-6aa9f49b0c65 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:41.939358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7250a5b-cbac-4557-b6de-6aa9f49b0c65 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:41.939851 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7250a5b-cbac-4557-b6de-6aa9f49b0c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:41.953959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:41.971346 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-d7250a5b-cbac-4557-b6de-6aa9f49b0c65 None None] MFA Rules not processed for user `cc01a035416845baa8c7abbcfaa20cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:41.972608 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d7250a5b-cbac-4557-b6de-6aa9f49b0c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:42.006323 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b014-1ddc-400e-b227-063136d9bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.007238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b014-1ddc-400e-b227-063136d9bd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.007804 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b014-1ddc-400e-b227-063136d9bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.008084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b014-1ddc-400e-b227-063136d9bd14 admin admin] PATH_INFO: `/v3/projects/c069e989ea4440eda190e578060daa9e/users/8b61740db21141a7be49f30f8aa90684/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.024860 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804b014-1ddc-400e-b227-063136d9bd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c069e989ea4440eda190e578060daa9e, user_id=8b61740db21141a7be49f30f8aa90684, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.028194 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804b014-1ddc-400e-b227-063136d9bd14 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.032068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:42.044316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1365/2709] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:41 2022] PUT /identity/v3/projects/c069e989ea4440eda190e578060daa9e/users/8b61740db21141a7be49f30f8aa90684/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:42.048479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b014-1ddc-400e-b227-063136d9bd14 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:42.057527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1345/2710] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:08:42.062381 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7250a5b-cbac-4557-b6de-6aa9f49b0c65 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:42.080159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7250a5b-cbac-4557-b6de-6aa9f49b0c65 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:42.114167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b014-1ddc-400e-b227-063136d9bd14 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:42.119420 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4642b-218c-473c-be3c-d0e60fdbc825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.120070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4642b-218c-473c-be3c-d0e60fdbc825 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.120360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4642b-218c-473c-be3c-d0e60fdbc825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.120641 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4642b-218c-473c-be3c-d0e60fdbc825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.122272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4642b-218c-473c-be3c-d0e60fdbc825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.123866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4642b-218c-473c-be3c-d0e60fdbc825 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.138553 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1366/2711] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:08:42.140015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4642b-218c-473c-be3c-d0e60fdbc825 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:42.148166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab6e9-4fc9-4d31-89cd-9655945f35a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.148846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab6e9-4fc9-4d31-89cd-9655945f35a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.149124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab6e9-4fc9-4d31-89cd-9655945f35a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.149396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab6e9-4fc9-4d31-89cd-9655945f35a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.149941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4642b-218c-473c-be3c-d0e60fdbc825 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:42.150119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcab6e9-4fc9-4d31-89cd-9655945f35a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.152217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcab6e9-4fc9-4d31-89cd-9655945f35a6 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.155371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c63013-3c09-4729-b793-96e7bcd919b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.156279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63013-3c09-4729-b793-96e7bcd919b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.156560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63013-3c09-4729-b793-96e7bcd919b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.156840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63013-3c09-4729-b793-96e7bcd919b5 admin admin] PATH_INFO: `/v3/projects/c069e989ea4440eda190e578060daa9e/users/8b61740db21141a7be49f30f8aa90684/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.158894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c63013-3c09-4729-b793-96e7bcd919b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c069e989ea4440eda190e578060daa9e, user_id=8b61740db21141a7be49f30f8aa90684, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.161567 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c63013-3c09-4729-b793-96e7bcd919b5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.173133 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1367/2712] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:42 2022] PUT /identity/v3/projects/c069e989ea4440eda190e578060daa9e/users/8b61740db21141a7be49f30f8aa90684/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:42.181409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1346/2713] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:42 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:08:42.183956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d50b6-90c2-4d13-b78f-3a6961f1e7af None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.184449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d50b6-90c2-4d13-b78f-3a6961f1e7af None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.184887 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d50b6-90c2-4d13-b78f-3a6961f1e7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.186249 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab6e9-4fc9-4d31-89cd-9655945f35a6 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:42.215770 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-843d50b6-90c2-4d13-b78f-3a6961f1e7af None None] MFA Rules not processed for user `8b61740db21141a7be49f30f8aa90684`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:42.217025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-843d50b6-90c2-4d13-b78f-3a6961f1e7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:42.254398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab6e9-4fc9-4d31-89cd-9655945f35a6 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:42.259836 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7584a-72fa-46c4-936d-61432b68bb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.260656 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7584a-72fa-46c4-936d-61432b68bb8c admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.260946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7584a-72fa-46c4-936d-61432b68bb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.261236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7584a-72fa-46c4-936d-61432b68bb8c admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.262553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7584a-72fa-46c4-936d-61432b68bb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.264518 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7584a-72fa-46c4-936d-61432b68bb8c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.286412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1347/2714] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:42 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:08:42.290469 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7584a-72fa-46c4-936d-61432b68bb8c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:42.292820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1368/2715] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:08:42.301298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7584a-72fa-46c4-936d-61432b68bb8c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:42.313802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d50b6-90c2-4d13-b78f-3a6961f1e7af None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:42.313802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-843d50b6-90c2-4d13-b78f-3a6961f1e7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:42.314122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf7ba7-4e20-4777-8e46-5f6603c8eb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.314122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf7ba7-4e20-4777-8e46-5f6603c8eb0b admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.314122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf7ba7-4e20-4777-8e46-5f6603c8eb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.314122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf7ba7-4e20-4777-8e46-5f6603c8eb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.314503 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf7ba7-4e20-4777-8e46-5f6603c8eb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.314503 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf7ba7-4e20-4777-8e46-5f6603c8eb0b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.319258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:42.329780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1348/2716] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:08:42.331354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf7ba7-4e20-4777-8e46-5f6603c8eb0b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:42.348462 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf7ba7-4e20-4777-8e46-5f6603c8eb0b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:42.354965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1873d17-349c-4350-82d0-91a879a3e9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.356494 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1873d17-349c-4350-82d0-91a879a3e9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.356955 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1873d17-349c-4350-82d0-91a879a3e9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.357407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1873d17-349c-4350-82d0-91a879a3e9cd admin admin] PATH_INFO: `/v3/projects/79f266833bb346d8bc85901db09389ff/users/d5c8e8af0d064833a457773a024a8598/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.381690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1873d17-349c-4350-82d0-91a879a3e9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f266833bb346d8bc85901db09389ff, user_id=d5c8e8af0d064833a457773a024a8598, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.387471 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1873d17-349c-4350-82d0-91a879a3e9cd admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.403661 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d50b6-90c2-4d13-b78f-3a6961f1e7af None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:42.408036 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1349/2717] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:42 2022] PUT /identity/v3/projects/79f266833bb346d8bc85901db09389ff/users/d5c8e8af0d064833a457773a024a8598/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:42.412388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1873d17-349c-4350-82d0-91a879a3e9cd admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:42.427262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:42.468581 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18b33d-8bce-46b2-8246-1ce24bc92336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.469242 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18b33d-8bce-46b2-8246-1ce24bc92336 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.469525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18b33d-8bce-46b2-8246-1ce24bc92336 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.469805 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18b33d-8bce-46b2-8246-1ce24bc92336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.488356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1873d17-349c-4350-82d0-91a879a3e9cd admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:42.493403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0affa53-d05a-4c11-8aca-e6fb1a52ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.494179 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0affa53-d05a-4c11-8aca-e6fb1a52ffe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.494466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0affa53-d05a-4c11-8aca-e6fb1a52ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.494744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0affa53-d05a-4c11-8aca-e6fb1a52ffe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.495532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0affa53-d05a-4c11-8aca-e6fb1a52ffe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.497799 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0affa53-d05a-4c11-8aca-e6fb1a52ffe8 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.514909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1350/2718] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:08:42.516269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0affa53-d05a-4c11-8aca-e6fb1a52ffe8 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:42.527638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0affa53-d05a-4c11-8aca-e6fb1a52ffe8 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:42.532420 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9f8bb-dfdf-490e-ba71-9f91486111dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.533309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9f8bb-dfdf-490e-ba71-9f91486111dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.533588 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9f8bb-dfdf-490e-ba71-9f91486111dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.533863 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9f8bb-dfdf-490e-ba71-9f91486111dd admin admin] PATH_INFO: `/v3/projects/79f266833bb346d8bc85901db09389ff/users/d5c8e8af0d064833a457773a024a8598/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.536000 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9f8bb-dfdf-490e-ba71-9f91486111dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f266833bb346d8bc85901db09389ff, user_id=d5c8e8af0d064833a457773a024a8598, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.538682 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9f8bb-dfdf-490e-ba71-9f91486111dd admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.538910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18b33d-8bce-46b2-8246-1ce24bc92336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.540354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18b33d-8bce-46b2-8246-1ce24bc92336 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.550684 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1351/2719] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:42 2022] PUT /identity/v3/projects/79f266833bb346d8bc85901db09389ff/users/d5c8e8af0d064833a457773a024a8598/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:42.551584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1369/2720] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:08:42.562983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94e25-1b41-46e3-a2ae-4affeed0abea None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.563271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94e25-1b41-46e3-a2ae-4affeed0abea None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.563579 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94e25-1b41-46e3-a2ae-4affeed0abea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.600770 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4ea94e25-1b41-46e3-a2ae-4affeed0abea None None] MFA Rules not processed for user `d5c8e8af0d064833a457773a024a8598`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:42.602046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4ea94e25-1b41-46e3-a2ae-4affeed0abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:42.698351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1352/2721] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:42.712372 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18b33d-8bce-46b2-8246-1ce24bc92336 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:42.721353 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18b33d-8bce-46b2-8246-1ce24bc92336 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:42.776277 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda436a-7c69-4316-9e58-105a8cbdd3e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.776943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda436a-7c69-4316-9e58-105a8cbdd3e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.777239 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda436a-7c69-4316-9e58-105a8cbdd3e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.777516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda436a-7c69-4316-9e58-105a8cbdd3e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.787657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda436a-7c69-4316-9e58-105a8cbdd3e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.789102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda436a-7c69-4316-9e58-105a8cbdd3e7 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.803360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1370/2722] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:42.890092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea94e25-1b41-46e3-a2ae-4affeed0abea None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:42.900416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea94e25-1b41-46e3-a2ae-4affeed0abea None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:42.904709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae627ab-d492-4e1d-acf2-e80263792e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:42.905369 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae627ab-d492-4e1d-acf2-e80263792e45 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:42.905651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae627ab-d492-4e1d-acf2-e80263792e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:42.905955 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae627ab-d492-4e1d-acf2-e80263792e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:42.958542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:42.981353 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae627ab-d492-4e1d-acf2-e80263792e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:42.982854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae627ab-d492-4e1d-acf2-e80263792e45 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:42.993165 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1353/2723] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:43.031142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda436a-7c69-4316-9e58-105a8cbdd3e7 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:43.115890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda436a-7c69-4316-9e58-105a8cbdd3e7 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:43.125190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:43.126255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:43.126541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:43.127096 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] PATH_INFO: `/v3/users/b514cfa716be429bbc7835b9d167bbb0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:43.128207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b514cfa716be429bbc7835b9d167bbb0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:43.130389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:43.152443 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:43.195141 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b514cfa716be429bbc7835b9d167bbb0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.195969 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b514cfa716be429bbc7835b9d167bbb0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.196587 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b514cfa716be429bbc7835b9d167bbb0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.204411 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b514cfa716be429bbc7835b9d167bbb0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.212180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b514cfa716be429bbc7835b9d167bbb0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.231873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1371/2724] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:43 2022] DELETE /identity/v3/users/b514cfa716be429bbc7835b9d167bbb0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:43.236413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69929b86-e474-4ce5-8d46-145cc548080e None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:43.236709 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69929b86-e474-4ce5-8d46-145cc548080e None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:43.236981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69929b86-e474-4ce5-8d46-145cc548080e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:43.254379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-69929b86-e474-4ce5-8d46-145cc548080e None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:43.255610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-69929b86-e474-4ce5-8d46-145cc548080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:43.320984 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1354/2725] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:43.334766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:43.336362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:43.404074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbcdfe-5712-43ad-998e-5fe0233d7e3b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:43.407819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f681703-dde0-4b56-ae8c-482766ff6a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:43.408487 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f681703-dde0-4b56-ae8c-482766ff6a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:43.408774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f681703-dde0-4b56-ae8c-482766ff6a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:43.409053 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f681703-dde0-4b56-ae8c-482766ff6a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:43.419116 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f681703-dde0-4b56-ae8c-482766ff6a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:43.420558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f681703-dde0-4b56-ae8c-482766ff6a6d service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:43.430681 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1372/2726] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:43.736233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69929b86-e474-4ce5-8d46-145cc548080e None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:43.737714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-69929b86-e474-4ce5-8d46-145cc548080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:43.751293 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69929b86-e474-4ce5-8d46-145cc548080e None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:43.756159 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:43.757042 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:43.757742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:43.758057 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] PATH_INFO: `/v3/projects/6e7ba23e50974fa696dea3dc77a59566` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:43.759348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7ba23e50974fa696dea3dc77a59566)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:43.761399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:43.812239 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7ba23e50974fa696dea3dc77a59566', 'request_id': 'req-7fa48f90-6319-4fff-abe5-808213a3df09'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.821479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7ba23e50974fa696dea3dc77a59566', 'request_id': 'req-7fa48f90-6319-4fff-abe5-808213a3df09'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.829036 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7ba23e50974fa696dea3dc77a59566', 'request_id': 'req-7fa48f90-6319-4fff-abe5-808213a3df09'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.842158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] The token cache is being invalidate because project 6e7ba23e50974fa696dea3dc77a59566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:43.842542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.843349 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.845380 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1355/2727] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:43 2022] DELETE /identity/v3/projects/6e7ba23e50974fa696dea3dc77a59566 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:43.849251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f681703-dde0-4b56-ae8c-482766ff6a6d service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:43.860066 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f681703-dde0-4b56-ae8c-482766ff6a6d service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:43.920182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a6f22-dec5-4adc-a4d9-14e0726ec373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:43.921041 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6f22-dec5-4adc-a4d9-14e0726ec373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:43.921324 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6f22-dec5-4adc-a4d9-14e0726ec373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:43.921604 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6f22-dec5-4adc-a4d9-14e0726ec373 admin admin] PATH_INFO: `/v3/users/8b61740db21141a7be49f30f8aa90684` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:43.922845 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a6f22-dec5-4adc-a4d9-14e0726ec373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b61740db21141a7be49f30f8aa90684)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:43.924766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a6f22-dec5-4adc-a4d9-14e0726ec373 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:43.965600 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:43.976427 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8e7a6f22-dec5-4adc-a4d9-14e0726ec373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b61740db21141a7be49f30f8aa90684'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.977081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8e7a6f22-dec5-4adc-a4d9-14e0726ec373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b61740db21141a7be49f30f8aa90684'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.977695 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8e7a6f22-dec5-4adc-a4d9-14e0726ec373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b61740db21141a7be49f30f8aa90684'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.985482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8e7a6f22-dec5-4adc-a4d9-14e0726ec373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b61740db21141a7be49f30f8aa90684'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:43.993051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8e7a6f22-dec5-4adc-a4d9-14e0726ec373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b61740db21141a7be49f30f8aa90684'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:44.012361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1373/2728] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:43 2022] DELETE /identity/v3/users/8b61740db21141a7be49f30f8aa90684 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:44.313326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:44.315911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:44.338740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48f90-6319-4fff-abe5-808213a3df09 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:44.409589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:44.410658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:44.411027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:44.411388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] PATH_INFO: `/v3/projects/c069e989ea4440eda190e578060daa9e` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:44.412807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c069e989ea4440eda190e578060daa9e)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:44.414850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:44.426531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:44.476990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c069e989ea4440eda190e578060daa9e', 'request_id': 'req-3b099703-a437-49b8-9efe-b3d5c35f609c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:44.486962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c069e989ea4440eda190e578060daa9e', 'request_id': 'req-3b099703-a437-49b8-9efe-b3d5c35f609c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:44.494177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c069e989ea4440eda190e578060daa9e', 'request_id': 'req-3b099703-a437-49b8-9efe-b3d5c35f609c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:44.508425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] The token cache is being invalidate because project c069e989ea4440eda190e578060daa9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:44.508714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:44.509360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-3b099703-a437-49b8-9efe-b3d5c35f609c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:44.511398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1356/2729] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:44 2022] DELETE /identity/v3/projects/c069e989ea4440eda190e578060daa9e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:44.516959 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cba81f-fe57-4eea-a60f-cb64afe4d6b6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:44.517279 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cba81f-fe57-4eea-a60f-cb64afe4d6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:44.517541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cba81f-fe57-4eea-a60f-cb64afe4d6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:44.542467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-34cba81f-fe57-4eea-a60f-cb64afe4d6b6 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:44.543912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-34cba81f-fe57-4eea-a60f-cb64afe4d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:44.632732 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1374/2730] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:44.642037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5422c-88eb-47b6-92a8-f82cd223e06d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:44.642425 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5422c-88eb-47b6-92a8-f82cd223e06d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:44.642708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5422c-88eb-47b6-92a8-f82cd223e06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:44.664126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-5cb5422c-88eb-47b6-92a8-f82cd223e06d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:44.665436 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5cb5422c-88eb-47b6-92a8-f82cd223e06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:44.674273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1357/2731] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:44.687123 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cba81f-fe57-4eea-a60f-cb64afe4d6b6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:44.702229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cba81f-fe57-4eea-a60f-cb64afe4d6b6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:44.708689 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f04eee-b869-4e1e-8d20-b4f6d1dfe40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:44.709873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04eee-b869-4e1e-8d20-b4f6d1dfe40d admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:44.709873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04eee-b869-4e1e-8d20-b4f6d1dfe40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:44.710112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04eee-b869-4e1e-8d20-b4f6d1dfe40d admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:44.710714 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f04eee-b869-4e1e-8d20-b4f6d1dfe40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:08:44.711068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f04eee-b869-4e1e-8d20-b4f6d1dfe40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:44.712584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f04eee-b869-4e1e-8d20-b4f6d1dfe40d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:44.726007 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1375/2732] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:08:44.731365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5422c-88eb-47b6-92a8-f82cd223e06d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:44.741039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5422c-88eb-47b6-92a8-f82cd223e06d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:44.748389 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae33234-fc2a-45d6-9b88-8e47d8d28980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:44.749216 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae33234-fc2a-45d6-9b88-8e47d8d28980 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:44.749491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae33234-fc2a-45d6-9b88-8e47d8d28980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:44.749764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae33234-fc2a-45d6-9b88-8e47d8d28980 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:44.750506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae33234-fc2a-45d6-9b88-8e47d8d28980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:44.752415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae33234-fc2a-45d6-9b88-8e47d8d28980 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:44.783481 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1358/2733] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:44 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:44.787339 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f04eee-b869-4e1e-8d20-b4f6d1dfe40d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:44.801409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f04eee-b869-4e1e-8d20-b4f6d1dfe40d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:44.862741 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17578693-6969-4435-8d71-72e7ef1db0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:44.863452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17578693-6969-4435-8d71-72e7ef1db0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:44.863693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17578693-6969-4435-8d71-72e7ef1db0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:44.863971 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17578693-6969-4435-8d71-72e7ef1db0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:44.864662 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17578693-6969-4435-8d71-72e7ef1db0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:44.866608 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17578693-6969-4435-8d71-72e7ef1db0c1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:44.890351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1376/2734] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:44 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:44.894573 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae33234-fc2a-45d6-9b88-8e47d8d28980 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:44.906234 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae33234-fc2a-45d6-9b88-8e47d8d28980 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:44.911430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd236e-6215-4c9b-b1a7-3a68e4558ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:44.912111 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd236e-6215-4c9b-b1a7-3a68e4558ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:44.912399 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd236e-6215-4c9b-b1a7-3a68e4558ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:44.912679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd236e-6215-4c9b-b1a7-3a68e4558ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:44.913523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd236e-6215-4c9b-b1a7-3a68e4558ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:44.915275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd236e-6215-4c9b-b1a7-3a68e4558ba4 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:44.932423 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1359/2735] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:44.937509 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17578693-6969-4435-8d71-72e7ef1db0c1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:44.947842 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17578693-6969-4435-8d71-72e7ef1db0c1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:44.953044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896826e4-5358-4e8b-aecc-7e1a13be20d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:44.953737 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896826e4-5358-4e8b-aecc-7e1a13be20d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:44.954060 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896826e4-5358-4e8b-aecc-7e1a13be20d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:44.954340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896826e4-5358-4e8b-aecc-7e1a13be20d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:44.955104 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896826e4-5358-4e8b-aecc-7e1a13be20d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:44.956735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896826e4-5358-4e8b-aecc-7e1a13be20d5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:44.968121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1377/2736] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:44.972320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd236e-6215-4c9b-b1a7-3a68e4558ba4 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:44.986036 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd236e-6215-4c9b-b1a7-3a68e4558ba4 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:44.989506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf8633-a348-4818-9544-99452afeaa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:44.990527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8633-a348-4818-9544-99452afeaa10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:44.990807 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8633-a348-4818-9544-99452afeaa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:44.991085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8633-a348-4818-9544-99452afeaa10 admin admin] PATH_INFO: `/v3/projects/7b390cdc87f844faace62d7055c6066c/users/f65074bdaee1469fb499c96a6c144d78/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.007802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf8633-a348-4818-9544-99452afeaa10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b390cdc87f844faace62d7055c6066c, user_id=f65074bdaee1469fb499c96a6c144d78, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:45.010593 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf8633-a348-4818-9544-99452afeaa10 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:45.025582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1360/2737] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:44 2022] PUT /identity/v3/projects/7b390cdc87f844faace62d7055c6066c/users/f65074bdaee1469fb499c96a6c144d78/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:45.037131 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb03147-aefd-4ec4-a8bb-5f8e6edeb87f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.037422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb03147-aefd-4ec4-a8bb-5f8e6edeb87f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.037705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb03147-aefd-4ec4-a8bb-5f8e6edeb87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.075726 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ecb03147-aefd-4ec4-a8bb-5f8e6edeb87f None None] MFA Rules not processed for user `f65074bdaee1469fb499c96a6c144d78`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:45.076988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ecb03147-aefd-4ec4-a8bb-5f8e6edeb87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:45.085905 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:45.153324 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1378/2738] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:45.158008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf8633-a348-4818-9544-99452afeaa10 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:45.222714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf8633-a348-4818-9544-99452afeaa10 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:45.227435 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc194d3-d65d-4884-bbd6-60f44fedd60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:45.228106 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc194d3-d65d-4884-bbd6-60f44fedd60a admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.228391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc194d3-d65d-4884-bbd6-60f44fedd60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.228671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc194d3-d65d-4884-bbd6-60f44fedd60a admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.229365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc194d3-d65d-4884-bbd6-60f44fedd60a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:45.232647 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc194d3-d65d-4884-bbd6-60f44fedd60a admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:45.262372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1361/2739] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:45 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:45.266353 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb03147-aefd-4ec4-a8bb-5f8e6edeb87f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:45.278354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb03147-aefd-4ec4-a8bb-5f8e6edeb87f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:45.340723 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038c05c-4a82-423a-b60c-a7f45f70e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:45.341403 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038c05c-4a82-423a-b60c-a7f45f70e927 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.341684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038c05c-4a82-423a-b60c-a7f45f70e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.341987 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038c05c-4a82-423a-b60c-a7f45f70e927 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.342692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038c05c-4a82-423a-b60c-a7f45f70e927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:45.344605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038c05c-4a82-423a-b60c-a7f45f70e927 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:45.366493 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1379/2740] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:45 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:45.370648 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc194d3-d65d-4884-bbd6-60f44fedd60a admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:45.381451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc194d3-d65d-4884-bbd6-60f44fedd60a admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:45.386908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b3391-98f2-4cdc-b527-b31a0eb30db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:45.387716 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3391-98f2-4cdc-b527-b31a0eb30db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.387998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3391-98f2-4cdc-b527-b31a0eb30db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.388274 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3391-98f2-4cdc-b527-b31a0eb30db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.388998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b3391-98f2-4cdc-b527-b31a0eb30db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:45.390644 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b3391-98f2-4cdc-b527-b31a0eb30db7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:45.401818 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1362/2741] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:45.406964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038c05c-4a82-423a-b60c-a7f45f70e927 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:45.416998 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038c05c-4a82-423a-b60c-a7f45f70e927 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:45.423371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4edd1-fc88-49fc-b09b-264a006439a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:45.424262 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4edd1-fc88-49fc-b09b-264a006439a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.424538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4edd1-fc88-49fc-b09b-264a006439a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.424810 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4edd1-fc88-49fc-b09b-264a006439a2 admin admin] PATH_INFO: `/v3/projects/8b0cdf7999604593bf7ffc4d1671ed96/users/d3e35b6c2d3d4cc7b8094ed84c817c86/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.441497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4edd1-fc88-49fc-b09b-264a006439a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0cdf7999604593bf7ffc4d1671ed96, user_id=d3e35b6c2d3d4cc7b8094ed84c817c86, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:45.444175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4edd1-fc88-49fc-b09b-264a006439a2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:45.459017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1380/2742] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:45 2022] PUT /identity/v3/projects/8b0cdf7999604593bf7ffc4d1671ed96/users/d3e35b6c2d3d4cc7b8094ed84c817c86/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:45.462989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b3391-98f2-4cdc-b527-b31a0eb30db7 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:45.473699 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b3391-98f2-4cdc-b527-b31a0eb30db7 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:45.477328 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:45.540434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f53453-d06b-428c-a13b-d0549e7caf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:45.541118 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53453-d06b-428c-a13b-d0549e7caf08 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.541403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53453-d06b-428c-a13b-d0549e7caf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.541680 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53453-d06b-428c-a13b-d0549e7caf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.543229 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f53453-d06b-428c-a13b-d0549e7caf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:45.544520 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f53453-d06b-428c-a13b-d0549e7caf08 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:45.555001 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1363/2743] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:08:45.559352 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4edd1-fc88-49fc-b09b-264a006439a2 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:45.571470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4edd1-fc88-49fc-b09b-264a006439a2 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:45.577002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afd77f-a2e3-4530-ab16-fc7ba27fe2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:45.577907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd77f-a2e3-4530-ab16-fc7ba27fe2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.578207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd77f-a2e3-4530-ab16-fc7ba27fe2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.578479 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd77f-a2e3-4530-ab16-fc7ba27fe2d9 admin admin] PATH_INFO: `/v3/projects/8b0cdf7999604593bf7ffc4d1671ed96/users/d3e35b6c2d3d4cc7b8094ed84c817c86/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.580496 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afd77f-a2e3-4530-ab16-fc7ba27fe2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0cdf7999604593bf7ffc4d1671ed96, user_id=d3e35b6c2d3d4cc7b8094ed84c817c86, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:45.583206 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afd77f-a2e3-4530-ab16-fc7ba27fe2d9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:45.594925 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1381/2744] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:45 2022] PUT /identity/v3/projects/8b0cdf7999604593bf7ffc4d1671ed96/users/d3e35b6c2d3d4cc7b8094ed84c817c86/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:45.606334 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1becc0-2199-4948-97a9-b2add7b6b44d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.606619 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1becc0-2199-4948-97a9-b2add7b6b44d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.606893 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1becc0-2199-4948-97a9-b2add7b6b44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.637371 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ab1becc0-2199-4948-97a9-b2add7b6b44d None None] MFA Rules not processed for user `d3e35b6c2d3d4cc7b8094ed84c817c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:45.638638 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ab1becc0-2199-4948-97a9-b2add7b6b44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:45.725463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1364/2745] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:45.737667 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afd77f-a2e3-4530-ab16-fc7ba27fe2d9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:45.739439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-44afd77f-a2e3-4530-ab16-fc7ba27fe2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:45.804121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afd77f-a2e3-4530-ab16-fc7ba27fe2d9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:45.808943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93962ccc-be40-4c13-af54-67f97032f817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:45.809622 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962ccc-be40-4c13-af54-67f97032f817 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.809964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962ccc-be40-4c13-af54-67f97032f817 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.810275 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962ccc-be40-4c13-af54-67f97032f817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.820836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93962ccc-be40-4c13-af54-67f97032f817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:45.822328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93962ccc-be40-4c13-af54-67f97032f817 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:45.832742 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1382/2746] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:45.911951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1becc0-2199-4948-97a9-b2add7b6b44d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:45.923571 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1becc0-2199-4948-97a9-b2add7b6b44d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:45.930940 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ffe8f-0b8b-44b7-a8df-77668e92abdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:45.931784 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ffe8f-0b8b-44b7-a8df-77668e92abdc service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.932075 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ffe8f-0b8b-44b7-a8df-77668e92abdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.932348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ffe8f-0b8b-44b7-a8df-77668e92abdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.994138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ffe8f-0b8b-44b7-a8df-77668e92abdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:45.995959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ffe8f-0b8b-44b7-a8df-77668e92abdc service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:46.005189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1365/2747] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:08:48.784733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93962ccc-be40-4c13-af54-67f97032f817 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:48.790192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:48.860019 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93962ccc-be40-4c13-af54-67f97032f817 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:48.864632 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:48.865516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:48.865799 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:48.866105 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] PATH_INFO: `/v3/users/f65074bdaee1469fb499c96a6c144d78` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:48.867348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65074bdaee1469fb499c96a6c144d78)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:48.869361 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:48.921373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65074bdaee1469fb499c96a6c144d78'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:48.922111 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65074bdaee1469fb499c96a6c144d78'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:48.922775 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65074bdaee1469fb499c96a6c144d78'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:48.929984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65074bdaee1469fb499c96a6c144d78'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:48.939797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65074bdaee1469fb499c96a6c144d78'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:48.959990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1383/2748] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:48 2022] DELETE /identity/v3/users/f65074bdaee1469fb499c96a6c144d78 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:48.965063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c14c-f862-4c9a-aa98-ff7be0c66414 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:48.965560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c14c-f862-4c9a-aa98-ff7be0c66414 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:48.965676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c14c-f862-4c9a-aa98-ff7be0c66414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:48.984354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c1c1c14c-f862-4c9a-aa98-ff7be0c66414 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:48.985782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c1c1c14c-f862-4c9a-aa98-ff7be0c66414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:49.008162 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=100 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:49.054671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1366/2749] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:49.064885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:49.066422 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:49.131869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df5a07-62bf-47ee-b0a0-dcfe14405c4b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:49.137380 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b7dcf-0e94-41ca-b65f-25d5a67efb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:49.138473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b7dcf-0e94-41ca-b65f-25d5a67efb53 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:49.138976 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b7dcf-0e94-41ca-b65f-25d5a67efb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:49.139445 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b7dcf-0e94-41ca-b65f-25d5a67efb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:49.156150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b7dcf-0e94-41ca-b65f-25d5a67efb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:49.156150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b7dcf-0e94-41ca-b65f-25d5a67efb53 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:49.165777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1384/2750] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:49.478125 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c14c-f862-4c9a-aa98-ff7be0c66414 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:49.480171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c1c1c14c-f862-4c9a-aa98-ff7be0c66414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:49.495311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c14c-f862-4c9a-aa98-ff7be0c66414 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:49.509076 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:49.510184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:49.510519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:49.510906 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] PATH_INFO: `/v3/projects/7b390cdc87f844faace62d7055c6066c` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:49.513387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b390cdc87f844faace62d7055c6066c)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:49.515635 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:49.568351 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b390cdc87f844faace62d7055c6066c', 'request_id': 'req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:49.577632 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b390cdc87f844faace62d7055c6066c', 'request_id': 'req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:49.584542 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b390cdc87f844faace62d7055c6066c', 'request_id': 'req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:49.597386 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] The token cache is being invalidate because project 7b390cdc87f844faace62d7055c6066c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:49.597684 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:49.598389 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:49.599960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1367/2751] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:49 2022] DELETE /identity/v3/projects/7b390cdc87f844faace62d7055c6066c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:49.604029 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b7dcf-0e94-41ca-b65f-25d5a67efb53 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:49.614940 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b7dcf-0e94-41ca-b65f-25d5a67efb53 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:49.643163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:49.683754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ea21c-3b91-41d3-a6e6-c8bff71c68da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:49.685022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea21c-3b91-41d3-a6e6-c8bff71c68da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:49.685306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea21c-3b91-41d3-a6e6-c8bff71c68da admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:49.685586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea21c-3b91-41d3-a6e6-c8bff71c68da admin admin] PATH_INFO: `/v3/users/d3e35b6c2d3d4cc7b8094ed84c817c86` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:49.686915 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ea21c-3b91-41d3-a6e6-c8bff71c68da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e35b6c2d3d4cc7b8094ed84c817c86)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:49.688891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ea21c-3b91-41d3-a6e6-c8bff71c68da admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:49.745965 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5c5ea21c-3b91-41d3-a6e6-c8bff71c68da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e35b6c2d3d4cc7b8094ed84c817c86'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:49.747164 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5c5ea21c-3b91-41d3-a6e6-c8bff71c68da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e35b6c2d3d4cc7b8094ed84c817c86'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:49.748082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5c5ea21c-3b91-41d3-a6e6-c8bff71c68da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e35b6c2d3d4cc7b8094ed84c817c86'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:49.760722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5c5ea21c-3b91-41d3-a6e6-c8bff71c68da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e35b6c2d3d4cc7b8094ed84c817c86'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:49.773396 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5c5ea21c-3b91-41d3-a6e6-c8bff71c68da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e35b6c2d3d4cc7b8094ed84c817c86'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:49.801018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1385/2752] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:49 2022] DELETE /identity/v3/users/d3e35b6c2d3d4cc7b8094ed84c817c86 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:50.101659 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:50.103210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:50.119105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0bc3f-1720-4c3a-bf41-db13919e50d0 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:50.204995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:50.205933 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:50.206223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:50.206499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] PATH_INFO: `/v3/projects/8b0cdf7999604593bf7ffc4d1671ed96` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:50.207705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0cdf7999604593bf7ffc4d1671ed96)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:50.209603 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:50.267815 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0cdf7999604593bf7ffc4d1671ed96', 'request_id': 'req-edab98ad-53c2-4b02-a5aa-06235ec7542b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:50.270503 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:50.276388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0cdf7999604593bf7ffc4d1671ed96', 'request_id': 'req-edab98ad-53c2-4b02-a5aa-06235ec7542b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:50.285772 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0cdf7999604593bf7ffc4d1671ed96', 'request_id': 'req-edab98ad-53c2-4b02-a5aa-06235ec7542b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:50.297875 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] The token cache is being invalidate because project 8b0cdf7999604593bf7ffc4d1671ed96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:50.298213 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:50.298869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-edab98ad-53c2-4b02-a5aa-06235ec7542b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:50.300430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1368/2753] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:50 2022] DELETE /identity/v3/projects/8b0cdf7999604593bf7ffc4d1671ed96 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:50.305430 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28886c23-303c-4d11-94bb-fb7bdf903dca None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:50.305719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28886c23-303c-4d11-94bb-fb7bdf903dca None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:50.306036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28886c23-303c-4d11-94bb-fb7bdf903dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:50.328004 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-28886c23-303c-4d11-94bb-fb7bdf903dca None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:50.329254 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-28886c23-303c-4d11-94bb-fb7bdf903dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:50.399139 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1386/2754] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:50.407657 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246cccd-5449-426c-a226-f7f48549190c None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:50.407945 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246cccd-5449-426c-a226-f7f48549190c None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:50.408233 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246cccd-5449-426c-a226-f7f48549190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:50.428782 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4246cccd-5449-426c-a226-f7f48549190c None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:50.430093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4246cccd-5449-426c-a226-f7f48549190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:50.440766 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1369/2755] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:50.445727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28886c23-303c-4d11-94bb-fb7bdf903dca None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:50.457156 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28886c23-303c-4d11-94bb-fb7bdf903dca None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:50.462016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c8f11-b268-4128-a3bf-870061308815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:50.462694 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8f11-b268-4128-a3bf-870061308815 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:50.462979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8f11-b268-4128-a3bf-870061308815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:50.463248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8f11-b268-4128-a3bf-870061308815 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:50.463984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c8f11-b268-4128-a3bf-870061308815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:08:50.464476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c8f11-b268-4128-a3bf-870061308815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:50.466108 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c8f11-b268-4128-a3bf-870061308815 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:50.481561 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1387/2756] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:08:50.487966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246cccd-5449-426c-a226-f7f48549190c None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:50.499802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246cccd-5449-426c-a226-f7f48549190c None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:50.505853 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d38a6-c990-47d3-9106-9a826f097893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:50.506562 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d38a6-c990-47d3-9106-9a826f097893 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:50.506844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d38a6-c990-47d3-9106-9a826f097893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:50.507161 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d38a6-c990-47d3-9106-9a826f097893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:50.508148 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d38a6-c990-47d3-9106-9a826f097893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:50.510504 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d38a6-c990-47d3-9106-9a826f097893 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:50.538010 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1370/2757] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:50 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:50.542923 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c8f11-b268-4128-a3bf-870061308815 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:50.557021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c8f11-b268-4128-a3bf-870061308815 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:50.593781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:50.625117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04647f5-f1c6-4741-92c6-fc6bd4210142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:50.625807 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04647f5-f1c6-4741-92c6-fc6bd4210142 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:50.626121 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04647f5-f1c6-4741-92c6-fc6bd4210142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:50.626398 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04647f5-f1c6-4741-92c6-fc6bd4210142 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:50.627091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04647f5-f1c6-4741-92c6-fc6bd4210142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:50.629000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04647f5-f1c6-4741-92c6-fc6bd4210142 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:50.655967 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1388/2758] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:50 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:50.657289 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d38a6-c990-47d3-9106-9a826f097893 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:50.668928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d38a6-c990-47d3-9106-9a826f097893 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:50.673839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c3eda-9e6d-400b-8028-9ed6ca5811fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:50.674675 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c3eda-9e6d-400b-8028-9ed6ca5811fe admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:50.674966 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c3eda-9e6d-400b-8028-9ed6ca5811fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:50.675281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c3eda-9e6d-400b-8028-9ed6ca5811fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:50.676044 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c3eda-9e6d-400b-8028-9ed6ca5811fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:50.677678 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c3eda-9e6d-400b-8028-9ed6ca5811fe admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:50.690746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1371/2759] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:50.694916 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04647f5-f1c6-4741-92c6-fc6bd4210142 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:50.706478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04647f5-f1c6-4741-92c6-fc6bd4210142 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:50.711521 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336995b-413b-419d-a519-ee3a3bfdeb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:50.712200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336995b-413b-419d-a519-ee3a3bfdeb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:50.712482 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336995b-413b-419d-a519-ee3a3bfdeb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:50.712960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336995b-413b-419d-a519-ee3a3bfdeb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:50.713762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336995b-413b-419d-a519-ee3a3bfdeb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:50.715709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336995b-413b-419d-a519-ee3a3bfdeb9d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:50.726721 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1389/2760] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:50.731626 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c3eda-9e6d-400b-8028-9ed6ca5811fe admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:50.743005 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c3eda-9e6d-400b-8028-9ed6ca5811fe admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:50.748564 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1546e-a484-41ca-b401-8493505bfda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:50.749476 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1546e-a484-41ca-b401-8493505bfda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:50.749768 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1546e-a484-41ca-b401-8493505bfda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:50.750079 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1546e-a484-41ca-b401-8493505bfda0 admin admin] PATH_INFO: `/v3/projects/3d7a778ba0d84220a4c9cde1a8dd86df/users/93e80ef1ec504392b2c4a7ce43901fdb/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:50.768365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1546e-a484-41ca-b401-8493505bfda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7a778ba0d84220a4c9cde1a8dd86df, user_id=93e80ef1ec504392b2c4a7ce43901fdb, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:50.771213 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1546e-a484-41ca-b401-8493505bfda0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:50.785839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1372/2761] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:50 2022] PUT /identity/v3/projects/3d7a778ba0d84220a4c9cde1a8dd86df/users/93e80ef1ec504392b2c4a7ce43901fdb/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:50.798322 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06847ab-cc7f-451e-8d09-8cde4cfa548c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:50.798610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06847ab-cc7f-451e-8d09-8cde4cfa548c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:50.798888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06847ab-cc7f-451e-8d09-8cde4cfa548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:50.831710 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e06847ab-cc7f-451e-8d09-8cde4cfa548c None None] MFA Rules not processed for user `93e80ef1ec504392b2c4a7ce43901fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:50.832908 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e06847ab-cc7f-451e-8d09-8cde4cfa548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:50.928683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1390/2762] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:50.934141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1546e-a484-41ca-b401-8493505bfda0 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:51.006173 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1546e-a484-41ca-b401-8493505bfda0 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:51.012273 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493b39-6a82-417e-93bb-a236a7e0661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:51.012956 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493b39-6a82-417e-93bb-a236a7e0661c admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:51.013235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493b39-6a82-417e-93bb-a236a7e0661c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:51.013509 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493b39-6a82-417e-93bb-a236a7e0661c admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:51.014240 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd493b39-6a82-417e-93bb-a236a7e0661c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:51.016816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd493b39-6a82-417e-93bb-a236a7e0661c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:51.051398 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1373/2763] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:50 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:51.055618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06847ab-cc7f-451e-8d09-8cde4cfa548c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:51.075821 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06847ab-cc7f-451e-8d09-8cde4cfa548c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:51.144251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719794f3-92de-4768-b1b2-84a2a13bfbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:51.145344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719794f3-92de-4768-b1b2-84a2a13bfbfc admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:51.145819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719794f3-92de-4768-b1b2-84a2a13bfbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:51.146346 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719794f3-92de-4768-b1b2-84a2a13bfbfc admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:51.147537 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719794f3-92de-4768-b1b2-84a2a13bfbfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:51.151110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719794f3-92de-4768-b1b2-84a2a13bfbfc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:51.177720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1391/2764] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:51 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:51.182093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493b39-6a82-417e-93bb-a236a7e0661c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:51.197777 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493b39-6a82-417e-93bb-a236a7e0661c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:51.204981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d43bf2-e5b4-4949-b2d0-9e28ae4c5ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:51.205665 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d43bf2-e5b4-4949-b2d0-9e28ae4c5ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:51.206002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d43bf2-e5b4-4949-b2d0-9e28ae4c5ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:51.206268 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d43bf2-e5b4-4949-b2d0-9e28ae4c5ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:51.206998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d43bf2-e5b4-4949-b2d0-9e28ae4c5ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:51.208598 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d43bf2-e5b4-4949-b2d0-9e28ae4c5ef7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:51.225671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1374/2765] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:08:51.226835 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719794f3-92de-4768-b1b2-84a2a13bfbfc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:51.239519 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719794f3-92de-4768-b1b2-84a2a13bfbfc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:51.248943 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aa50e-d150-4163-a3f8-ca05f56d5a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:51.250238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa50e-d150-4163-a3f8-ca05f56d5a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:51.250674 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa50e-d150-4163-a3f8-ca05f56d5a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:51.251099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa50e-d150-4163-a3f8-ca05f56d5a4e admin admin] PATH_INFO: `/v3/projects/b79720e0690e44c8bbc86b553d5eb8d5/users/d84dcc4f277648eead64264a16838fc7/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:51.273586 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aa50e-d150-4163-a3f8-ca05f56d5a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79720e0690e44c8bbc86b553d5eb8d5, user_id=d84dcc4f277648eead64264a16838fc7, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:51.276421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aa50e-d150-4163-a3f8-ca05f56d5a4e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:51.298281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1392/2766] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:51 2022] PUT /identity/v3/projects/b79720e0690e44c8bbc86b553d5eb8d5/users/d84dcc4f277648eead64264a16838fc7/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:51.305217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d43bf2-e5b4-4949-b2d0-9e28ae4c5ef7 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:51.317149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d43bf2-e5b4-4949-b2d0-9e28ae4c5ef7 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:51.378930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:51.392301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a07514-edac-4cb4-a746-66fa040ba0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:51.392980 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a07514-edac-4cb4-a746-66fa040ba0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:51.393267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a07514-edac-4cb4-a746-66fa040ba0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:51.393545 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a07514-edac-4cb4-a746-66fa040ba0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:51.394310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a07514-edac-4cb4-a746-66fa040ba0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:51.396861 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a07514-edac-4cb4-a746-66fa040ba0b5 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:51.409932 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1375/2767] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:51.413396 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aa50e-d150-4163-a3f8-ca05f56d5a4e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:51.426374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aa50e-d150-4163-a3f8-ca05f56d5a4e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:51.431291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b399cf-ca91-4244-a60e-6e3402d3a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:51.432341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b399cf-ca91-4244-a60e-6e3402d3a18e admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:51.432612 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b399cf-ca91-4244-a60e-6e3402d3a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:51.433049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b399cf-ca91-4244-a60e-6e3402d3a18e admin admin] PATH_INFO: `/v3/projects/b79720e0690e44c8bbc86b553d5eb8d5/users/d84dcc4f277648eead64264a16838fc7/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:51.436679 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b399cf-ca91-4244-a60e-6e3402d3a18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79720e0690e44c8bbc86b553d5eb8d5, user_id=d84dcc4f277648eead64264a16838fc7, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:51.439724 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b399cf-ca91-4244-a60e-6e3402d3a18e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:51.442889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:51.455809 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1393/2768] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:51 2022] PUT /identity/v3/projects/b79720e0690e44c8bbc86b553d5eb8d5/users/d84dcc4f277648eead64264a16838fc7/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:51.467388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf1504-c736-4d57-95f3-e7943526725f None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:51.467676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf1504-c736-4d57-95f3-e7943526725f None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:51.467950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf1504-c736-4d57-95f3-e7943526725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:51.504582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-edcf1504-c736-4d57-95f3-e7943526725f None None] MFA Rules not processed for user `d84dcc4f277648eead64264a16838fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:51.506020 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-edcf1504-c736-4d57-95f3-e7943526725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:51.596589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1376/2769] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:51.608128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b399cf-ca91-4244-a60e-6e3402d3a18e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:51.610847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-89b399cf-ca91-4244-a60e-6e3402d3a18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:51.685949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b399cf-ca91-4244-a60e-6e3402d3a18e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:51.690634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54213ee9-6d7b-474f-a34a-b58bccc7eaff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:51.691356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54213ee9-6d7b-474f-a34a-b58bccc7eaff service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:51.691700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54213ee9-6d7b-474f-a34a-b58bccc7eaff service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:51.691962 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54213ee9-6d7b-474f-a34a-b58bccc7eaff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:51.703020 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54213ee9-6d7b-474f-a34a-b58bccc7eaff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:51.704484 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54213ee9-6d7b-474f-a34a-b58bccc7eaff service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:51.717530 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1394/2770] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:52.343231 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf1504-c736-4d57-95f3-e7943526725f None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:52.416745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf1504-c736-4d57-95f3-e7943526725f None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:52.422589 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:52.423798 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:52.424081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:52.424409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] PATH_INFO: `/v3/users/93e80ef1ec504392b2c4a7ce43901fdb` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:52.425964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e80ef1ec504392b2c4a7ce43901fdb)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:52.427992 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:52.487511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e80ef1ec504392b2c4a7ce43901fdb'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:52.495021 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e80ef1ec504392b2c4a7ce43901fdb'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:52.511700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e80ef1ec504392b2c4a7ce43901fdb'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:52.512485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e80ef1ec504392b2c4a7ce43901fdb'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:52.514396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:52.535880 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e80ef1ec504392b2c4a7ce43901fdb'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:52.544087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1377/2771] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:52 2022] DELETE /identity/v3/users/93e80ef1ec504392b2c4a7ce43901fdb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:52.549054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5b36-afb1-42b2-a3a2-1a57501d1220 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:52.549508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5b36-afb1-42b2-a3a2-1a57501d1220 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:52.549758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5b36-afb1-42b2-a3a2-1a57501d1220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:52.573692 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ac1d5b36-afb1-42b2-a3a2-1a57501d1220 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:52.575288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ac1d5b36-afb1-42b2-a3a2-1a57501d1220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:52.649318 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1395/2772] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:52.660335 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:52.661946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:52.729479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55041c-8ae3-4be8-bcdd-40d3ba384843 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:52.734188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c1e9-86c5-4751-ab67-0998fa277c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:52.734788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c1e9-86c5-4751-ab67-0998fa277c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:52.735080 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c1e9-86c5-4751-ab67-0998fa277c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:52.735356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c1e9-86c5-4751-ab67-0998fa277c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:52.745622 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412c1e9-86c5-4751-ab67-0998fa277c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:52.747239 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412c1e9-86c5-4751-ab67-0998fa277c9d service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:52.758079 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1378/2773] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:53.066685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d5b36-afb1-42b2-a3a2-1a57501d1220 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:53.069434 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ac1d5b36-afb1-42b2-a3a2-1a57501d1220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:53.098820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d5b36-afb1-42b2-a3a2-1a57501d1220 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:53.103523 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:53.105360 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:53.106103 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:53.106562 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] PATH_INFO: `/v3/projects/3d7a778ba0d84220a4c9cde1a8dd86df` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:53.107991 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7a778ba0d84220a4c9cde1a8dd86df)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:53.109912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:53.165548 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7a778ba0d84220a4c9cde1a8dd86df', 'request_id': 'req-1016f77e-99f2-4c66-a9ca-17da7357a042'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.176992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7a778ba0d84220a4c9cde1a8dd86df', 'request_id': 'req-1016f77e-99f2-4c66-a9ca-17da7357a042'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.185314 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7a778ba0d84220a4c9cde1a8dd86df', 'request_id': 'req-1016f77e-99f2-4c66-a9ca-17da7357a042'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.196378 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] The token cache is being invalidate because project 3d7a778ba0d84220a4c9cde1a8dd86df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:53.196668 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.197371 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.200064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1396/2774] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:53 2022] DELETE /identity/v3/projects/3d7a778ba0d84220a4c9cde1a8dd86df => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:53.204203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c1e9-86c5-4751-ab67-0998fa277c9d service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:53.213778 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c1e9-86c5-4751-ab67-0998fa277c9d service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:53.276309 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:53.278364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:53.278649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:53.278928 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] PATH_INFO: `/v3/users/d84dcc4f277648eead64264a16838fc7` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:53.280329 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84dcc4f277648eead64264a16838fc7)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:53.282389 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:53.345621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84dcc4f277648eead64264a16838fc7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.352837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84dcc4f277648eead64264a16838fc7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.374769 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84dcc4f277648eead64264a16838fc7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.375735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84dcc4f277648eead64264a16838fc7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.384651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84dcc4f277648eead64264a16838fc7'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.391596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1379/2775] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:53 2022] DELETE /identity/v3/users/d84dcc4f277648eead64264a16838fc7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:53.755579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:53.758451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:53.782278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f77e-99f2-4c66-a9ca-17da7357a042 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:53.814397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:53.868590 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:53.869473 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:53.869748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:53.870054 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] PATH_INFO: `/v3/projects/b79720e0690e44c8bbc86b553d5eb8d5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:53.871922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79720e0690e44c8bbc86b553d5eb8d5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:53.873898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:53.931579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79720e0690e44c8bbc86b553d5eb8d5', 'request_id': 'req-e5c3f700-1c1b-4463-bc86-4bc9607e84be'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.941643 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79720e0690e44c8bbc86b553d5eb8d5', 'request_id': 'req-e5c3f700-1c1b-4463-bc86-4bc9607e84be'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.949472 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79720e0690e44c8bbc86b553d5eb8d5', 'request_id': 'req-e5c3f700-1c1b-4463-bc86-4bc9607e84be'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.961812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] The token cache is being invalidate because project b79720e0690e44c8bbc86b553d5eb8d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:53.962186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.962917 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e5c3f700-1c1b-4463-bc86-4bc9607e84be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:53.965261 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1397/2776] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:53 2022] DELETE /identity/v3/projects/b79720e0690e44c8bbc86b553d5eb8d5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:56.426158 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:56.427797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:56.444543 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d35ee7-fa5d-496a-8ae3-400e058be8e3 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:56.456698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:56.523079 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:56.525193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:56.525479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:56.525760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] PATH_INFO: `/v3/users/e18548faba1d4dd0a999a44084fe17f3` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:56.528392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18548faba1d4dd0a999a44084fe17f3)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:56.534733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:56.600742 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18548faba1d4dd0a999a44084fe17f3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:56.609479 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18548faba1d4dd0a999a44084fe17f3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:56.628024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18548faba1d4dd0a999a44084fe17f3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:56.628907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18548faba1d4dd0a999a44084fe17f3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:56.637433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18548faba1d4dd0a999a44084fe17f3'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:56.643792 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1380/2777] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:56 2022] DELETE /identity/v3/users/e18548faba1d4dd0a999a44084fe17f3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:08:56.648470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed7d36-6007-4325-b8b7-27e5922905f9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:56.649331 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed7d36-6007-4325-b8b7-27e5922905f9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:56.649615 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed7d36-6007-4325-b8b7-27e5922905f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:56.672044 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c9ed7d36-6007-4325-b8b7-27e5922905f9 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:56.673450 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c9ed7d36-6007-4325-b8b7-27e5922905f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:56.736269 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1398/2778] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:56.747867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:56.749529 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:56.811356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f17fcc-cb56-422c-8196-e8d218b46750 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:56.815121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cc45-33cd-4a30-a153-d8f1835edcd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:56.815779 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cc45-33cd-4a30-a153-d8f1835edcd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:56.816063 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cc45-33cd-4a30-a153-d8f1835edcd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:56.816340 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cc45-33cd-4a30-a153-d8f1835edcd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:56.826702 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001cc45-33cd-4a30-a153-d8f1835edcd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:56.828166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001cc45-33cd-4a30-a153-d8f1835edcd0 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:56.840114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1381/2779] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:57.131355 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed7d36-6007-4325-b8b7-27e5922905f9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:57.133080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c9ed7d36-6007-4325-b8b7-27e5922905f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:57.146399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed7d36-6007-4325-b8b7-27e5922905f9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:57.151084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:57.152248 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:57.152539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:57.152811 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] PATH_INFO: `/v3/projects/75fabf7ff26941a7a986b6608d70d1e0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:57.154252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75fabf7ff26941a7a986b6608d70d1e0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:57.156208 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:57.203306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:57.207578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75fabf7ff26941a7a986b6608d70d1e0', 'request_id': 'req-756c65bb-01c3-420d-94de-fb7a597ac82c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:57.217017 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75fabf7ff26941a7a986b6608d70d1e0', 'request_id': 'req-756c65bb-01c3-420d-94de-fb7a597ac82c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:57.224110 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75fabf7ff26941a7a986b6608d70d1e0', 'request_id': 'req-756c65bb-01c3-420d-94de-fb7a597ac82c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:57.235088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] The token cache is being invalidate because project 75fabf7ff26941a7a986b6608d70d1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:57.235288 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:57.235972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-756c65bb-01c3-420d-94de-fb7a597ac82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:57.237596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1399/2780] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:57 2022] DELETE /identity/v3/projects/75fabf7ff26941a7a986b6608d70d1e0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:06.834652 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=73,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:07.231758 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:15.921448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cc45-33cd-4a30-a153-d8f1835edcd0 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:15.922930 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3001cc45-33cd-4a30-a153-d8f1835edcd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:15.937262 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cc45-33cd-4a30-a153-d8f1835edcd0 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:15.999152 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:16.000031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:16.000326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:16.000581 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] PATH_INFO: `/v3/users/cc01a035416845baa8c7abbcfaa20cfa` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:16.001781 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc01a035416845baa8c7abbcfaa20cfa)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:16.003736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:16.053614 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc01a035416845baa8c7abbcfaa20cfa'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.061323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc01a035416845baa8c7abbcfaa20cfa'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.072501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc01a035416845baa8c7abbcfaa20cfa'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.073753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc01a035416845baa8c7abbcfaa20cfa'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.081944 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc01a035416845baa8c7abbcfaa20cfa'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.088374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1382/2781] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:15 2022] DELETE /identity/v3/users/cc01a035416845baa8c7abbcfaa20cfa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:16.094251 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee7130-c6dd-4961-a97f-10ddaa2cfae8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:16.094780 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee7130-c6dd-4961-a97f-10ddaa2cfae8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:16.095094 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee7130-c6dd-4961-a97f-10ddaa2cfae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:16.117840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e6ee7130-c6dd-4961-a97f-10ddaa2cfae8 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:16.119753 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e6ee7130-c6dd-4961-a97f-10ddaa2cfae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:16.190958 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1400/2782] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:09:16.197683 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:16.201171 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:16.263759 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9464ffc-6061-4064-a1b9-c7187b29967b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:16.267489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753090a-eb5a-4614-b5bd-9eea013bef3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:16.268153 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753090a-eb5a-4614-b5bd-9eea013bef3e service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:16.268431 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753090a-eb5a-4614-b5bd-9eea013bef3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:16.268713 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753090a-eb5a-4614-b5bd-9eea013bef3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:16.279390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753090a-eb5a-4614-b5bd-9eea013bef3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:16.280849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753090a-eb5a-4614-b5bd-9eea013bef3e service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:16.291039 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1383/2783] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:16.579847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee7130-c6dd-4961-a97f-10ddaa2cfae8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:16.581486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e6ee7130-c6dd-4961-a97f-10ddaa2cfae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:16.595182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee7130-c6dd-4961-a97f-10ddaa2cfae8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:16.600074 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:16.600964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:16.601328 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:16.601499 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] PATH_INFO: `/v3/projects/140c707eb5404b8a8d0348b4ee6199d3` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:16.603237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=140c707eb5404b8a8d0348b4ee6199d3)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:16.605197 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:16.656102 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140c707eb5404b8a8d0348b4ee6199d3', 'request_id': 'req-3a750bf8-f08b-4ab1-9eb7-fd402543f776'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.664772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140c707eb5404b8a8d0348b4ee6199d3', 'request_id': 'req-3a750bf8-f08b-4ab1-9eb7-fd402543f776'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.672369 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140c707eb5404b8a8d0348b4ee6199d3', 'request_id': 'req-3a750bf8-f08b-4ab1-9eb7-fd402543f776'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.684278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] The token cache is being invalidate because project 140c707eb5404b8a8d0348b4ee6199d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:16.684597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.685307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.686912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1401/2784] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:16 2022] DELETE /identity/v3/projects/140c707eb5404b8a8d0348b4ee6199d3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:16.691178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753090a-eb5a-4614-b5bd-9eea013bef3e service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:16.701774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753090a-eb5a-4614-b5bd-9eea013bef3e service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:16.723554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:16.767372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790bb42-c9f8-48f2-af45-b4167a5168fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:16.768256 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790bb42-c9f8-48f2-af45-b4167a5168fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:16.768533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790bb42-c9f8-48f2-af45-b4167a5168fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:16.768802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790bb42-c9f8-48f2-af45-b4167a5168fe admin admin] PATH_INFO: `/v3/users/d5c8e8af0d064833a457773a024a8598` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:16.770041 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790bb42-c9f8-48f2-af45-b4167a5168fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c8e8af0d064833a457773a024a8598)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:16.771951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790bb42-c9f8-48f2-af45-b4167a5168fe admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:16.821499 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c790bb42-c9f8-48f2-af45-b4167a5168fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c8e8af0d064833a457773a024a8598'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.830522 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c790bb42-c9f8-48f2-af45-b4167a5168fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c8e8af0d064833a457773a024a8598'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.843597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c790bb42-c9f8-48f2-af45-b4167a5168fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c8e8af0d064833a457773a024a8598'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.844336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c790bb42-c9f8-48f2-af45-b4167a5168fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c8e8af0d064833a457773a024a8598'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.852728 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c790bb42-c9f8-48f2-af45-b4167a5168fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c8e8af0d064833a457773a024a8598'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:16.859947 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1384/2785] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:16 2022] DELETE /identity/v3/users/d5c8e8af0d064833a457773a024a8598 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:17.154080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:17.155560 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:17.169968 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a750bf8-f08b-4ab1-9eb7-fd402543f776 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:17.232660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:17.233512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:17.233795 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:17.234101 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] PATH_INFO: `/v3/projects/79f266833bb346d8bc85901db09389ff` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:17.235327 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f266833bb346d8bc85901db09389ff)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:17.237228 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:17.270542 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:17.289580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f266833bb346d8bc85901db09389ff', 'request_id': 'req-711a2f43-6117-4115-b21c-9f8daae51a78'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:17.298602 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f266833bb346d8bc85901db09389ff', 'request_id': 'req-711a2f43-6117-4115-b21c-9f8daae51a78'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:17.305413 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f266833bb346d8bc85901db09389ff', 'request_id': 'req-711a2f43-6117-4115-b21c-9f8daae51a78'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:17.318762 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] The token cache is being invalidate because project 79f266833bb346d8bc85901db09389ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:17.319049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:17.319709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-711a2f43-6117-4115-b21c-9f8daae51a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:17.321265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1402/2786] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:17 2022] DELETE /identity/v3/projects/79f266833bb346d8bc85901db09389ff => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:17.330062 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cba43-6ae0-4cb5-93ea-4a90a6331d85 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:17.330839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cba43-6ae0-4cb5-93ea-4a90a6331d85 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:17.330839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cba43-6ae0-4cb5-93ea-4a90a6331d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:17.354007 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b22cba43-6ae0-4cb5-93ea-4a90a6331d85 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:17.356689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b22cba43-6ae0-4cb5-93ea-4a90a6331d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:17.422107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1385/2787] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:17.430140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f72d9-6b3f-4ee5-9251-ca0d9bd11d90 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:17.430656 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f72d9-6b3f-4ee5-9251-ca0d9bd11d90 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:17.430808 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f72d9-6b3f-4ee5-9251-ca0d9bd11d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:17.451469 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-070f72d9-6b3f-4ee5-9251-ca0d9bd11d90 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:17.452690 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-070f72d9-6b3f-4ee5-9251-ca0d9bd11d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:17.460822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1403/2788] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:17.465913 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cba43-6ae0-4cb5-93ea-4a90a6331d85 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:17.475980 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cba43-6ae0-4cb5-93ea-4a90a6331d85 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:17.482312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16fa32-f0ec-47bc-b57c-06ffe92758d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:17.482995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16fa32-f0ec-47bc-b57c-06ffe92758d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:17.483275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16fa32-f0ec-47bc-b57c-06ffe92758d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:17.483549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16fa32-f0ec-47bc-b57c-06ffe92758d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:17.484281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16fa32-f0ec-47bc-b57c-06ffe92758d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:09:17.484586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16fa32-f0ec-47bc-b57c-06ffe92758d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:17.486213 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16fa32-f0ec-47bc-b57c-06ffe92758d6 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:17.498721 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1386/2789] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:09:17.503073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f72d9-6b3f-4ee5-9251-ca0d9bd11d90 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:17.513665 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f72d9-6b3f-4ee5-9251-ca0d9bd11d90 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:17.518365 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbca0c9-4873-4327-89fb-3d9a7745baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:17.519028 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbca0c9-4873-4327-89fb-3d9a7745baf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:17.519309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbca0c9-4873-4327-89fb-3d9a7745baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:17.519580 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbca0c9-4873-4327-89fb-3d9a7745baf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:17.520282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbca0c9-4873-4327-89fb-3d9a7745baf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:17.522190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbca0c9-4873-4327-89fb-3d9a7745baf5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:17.550890 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1404/2790] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:17 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:17.554912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16fa32-f0ec-47bc-b57c-06ffe92758d6 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:17.583727 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16fa32-f0ec-47bc-b57c-06ffe92758d6 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:17.618164 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:17.653739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb77e7c-c487-4314-91ef-cce567106b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:17.654456 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb77e7c-c487-4314-91ef-cce567106b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:17.654740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb77e7c-c487-4314-91ef-cce567106b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:17.655015 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb77e7c-c487-4314-91ef-cce567106b77 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:17.655708 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb77e7c-c487-4314-91ef-cce567106b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:17.657676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb77e7c-c487-4314-91ef-cce567106b77 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:17.680788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1387/2791] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:17 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:17.686145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbca0c9-4873-4327-89fb-3d9a7745baf5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:17.697192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbca0c9-4873-4327-89fb-3d9a7745baf5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:17.702255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42af419-747d-4457-9bc1-4e77745b6d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:17.702937 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af419-747d-4457-9bc1-4e77745b6d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:17.703216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af419-747d-4457-9bc1-4e77745b6d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:17.703489 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af419-747d-4457-9bc1-4e77745b6d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:17.704211 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42af419-747d-4457-9bc1-4e77745b6d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:17.705808 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42af419-747d-4457-9bc1-4e77745b6d38 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:17.717841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1405/2792] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:09:17.722093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb77e7c-c487-4314-91ef-cce567106b77 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:17.733757 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb77e7c-c487-4314-91ef-cce567106b77 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:17.739002 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d914b3-a67f-4664-ac9a-23155fd4d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:17.739679 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d914b3-a67f-4664-ac9a-23155fd4d9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:17.739964 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d914b3-a67f-4664-ac9a-23155fd4d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:17.740258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d914b3-a67f-4664-ac9a-23155fd4d9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:17.740974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d914b3-a67f-4664-ac9a-23155fd4d9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:17.742612 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d914b3-a67f-4664-ac9a-23155fd4d9e0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:17.754788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1388/2793] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:17.759344 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42af419-747d-4457-9bc1-4e77745b6d38 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:17.769906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42af419-747d-4457-9bc1-4e77745b6d38 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:17.774660 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc89f0-fa18-4545-a586-3feab2e5358d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:17.775558 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc89f0-fa18-4545-a586-3feab2e5358d admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:17.775843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc89f0-fa18-4545-a586-3feab2e5358d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:17.776622 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc89f0-fa18-4545-a586-3feab2e5358d admin admin] PATH_INFO: `/v3/projects/6f30b832b6ea4471b25415511bfa2aae/users/b8123cdd0e074583afa9d45741a0b68c/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:17.797373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc89f0-fa18-4545-a586-3feab2e5358d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f30b832b6ea4471b25415511bfa2aae, user_id=b8123cdd0e074583afa9d45741a0b68c, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:17.800088 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc89f0-fa18-4545-a586-3feab2e5358d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:17.814267 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1406/2794] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:17 2022] PUT /identity/v3/projects/6f30b832b6ea4471b25415511bfa2aae/users/b8123cdd0e074583afa9d45741a0b68c/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:09:17.825596 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471fe40-7b86-49db-97e6-dd6a757244a4 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:17.826078 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471fe40-7b86-49db-97e6-dd6a757244a4 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:17.826357 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471fe40-7b86-49db-97e6-dd6a757244a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:17.860402 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-1471fe40-7b86-49db-97e6-dd6a757244a4 None None] MFA Rules not processed for user `b8123cdd0e074583afa9d45741a0b68c`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:17.861643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-1471fe40-7b86-49db-97e6-dd6a757244a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:17.938554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1389/2795] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:17.943180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc89f0-fa18-4545-a586-3feab2e5358d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:18.017873 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc89f0-fa18-4545-a586-3feab2e5358d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:18.024037 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67c526-8871-4e08-9aa2-5e995c624dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:18.024766 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67c526-8871-4e08-9aa2-5e995c624dba admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:18.025050 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67c526-8871-4e08-9aa2-5e995c624dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:18.025319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67c526-8871-4e08-9aa2-5e995c624dba admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:18.026569 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67c526-8871-4e08-9aa2-5e995c624dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:18.028475 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67c526-8871-4e08-9aa2-5e995c624dba admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:18.058786 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1407/2796] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:17 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:09:18.062974 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471fe40-7b86-49db-97e6-dd6a757244a4 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:18.074610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471fe40-7b86-49db-97e6-dd6a757244a4 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:18.134356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d10728-68b8-4fb8-81dd-5ad7676348c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:18.135035 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d10728-68b8-4fb8-81dd-5ad7676348c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:18.135867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d10728-68b8-4fb8-81dd-5ad7676348c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:18.136145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d10728-68b8-4fb8-81dd-5ad7676348c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:18.136846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d10728-68b8-4fb8-81dd-5ad7676348c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:18.139067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d10728-68b8-4fb8-81dd-5ad7676348c4 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:18.160014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1390/2797] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:18 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:18.163970 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67c526-8871-4e08-9aa2-5e995c624dba admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:18.174958 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67c526-8871-4e08-9aa2-5e995c624dba admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:18.179672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05998051-651e-448c-85fc-27f417be8ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:18.180345 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05998051-651e-448c-85fc-27f417be8ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:18.180631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05998051-651e-448c-85fc-27f417be8ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:18.180906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05998051-651e-448c-85fc-27f417be8ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:18.181630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05998051-651e-448c-85fc-27f417be8ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:18.183317 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05998051-651e-448c-85fc-27f417be8ea5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:18.194329 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1408/2798] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:18.200279 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d10728-68b8-4fb8-81dd-5ad7676348c4 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:18.211165 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d10728-68b8-4fb8-81dd-5ad7676348c4 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:18.217210 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa5dcd-372b-412d-93e4-ebc6bf6a47eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:18.218166 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa5dcd-372b-412d-93e4-ebc6bf6a47eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:18.218447 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa5dcd-372b-412d-93e4-ebc6bf6a47eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:18.218722 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa5dcd-372b-412d-93e4-ebc6bf6a47eb admin admin] PATH_INFO: `/v3/projects/e5e98c0a75804e54aea3158cb3466ad5/users/21d482a8fa634d40b89786c6e3beb25e/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:18.235530 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa5dcd-372b-412d-93e4-ebc6bf6a47eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e98c0a75804e54aea3158cb3466ad5, user_id=21d482a8fa634d40b89786c6e3beb25e, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:18.238219 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa5dcd-372b-412d-93e4-ebc6bf6a47eb admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:18.258069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1391/2799] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:18 2022] PUT /identity/v3/projects/e5e98c0a75804e54aea3158cb3466ad5/users/21d482a8fa634d40b89786c6e3beb25e/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:18.263204 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05998051-651e-448c-85fc-27f417be8ea5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:18.273598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05998051-651e-448c-85fc-27f417be8ea5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:18.302768 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:18.346185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326e507-583b-48a5-b81e-e861e32eab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:18.346900 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e507-583b-48a5-b81e-e861e32eab82 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:18.347185 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e507-583b-48a5-b81e-e861e32eab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:18.347459 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e507-583b-48a5-b81e-e861e32eab82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:18.348188 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326e507-583b-48a5-b81e-e861e32eab82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:18.349871 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326e507-583b-48a5-b81e-e861e32eab82 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:18.362186 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1409/2800] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:18.367226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa5dcd-372b-412d-93e4-ebc6bf6a47eb admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:18.373804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:18.380536 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa5dcd-372b-412d-93e4-ebc6bf6a47eb admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:18.386451 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bd666-33bf-4f07-9fac-5b6288f41a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:18.387665 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bd666-33bf-4f07-9fac-5b6288f41a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:18.388052 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bd666-33bf-4f07-9fac-5b6288f41a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:18.388454 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bd666-33bf-4f07-9fac-5b6288f41a12 admin admin] PATH_INFO: `/v3/projects/e5e98c0a75804e54aea3158cb3466ad5/users/21d482a8fa634d40b89786c6e3beb25e/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:18.390692 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3bd666-33bf-4f07-9fac-5b6288f41a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e98c0a75804e54aea3158cb3466ad5, user_id=21d482a8fa634d40b89786c6e3beb25e, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:18.393385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3bd666-33bf-4f07-9fac-5b6288f41a12 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:18.404895 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1392/2801] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:18 2022] PUT /identity/v3/projects/e5e98c0a75804e54aea3158cb3466ad5/users/21d482a8fa634d40b89786c6e3beb25e/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:18.415309 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170963-1058-4051-b912-f132ed98ab1e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:18.415532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170963-1058-4051-b912-f132ed98ab1e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:18.415771 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170963-1058-4051-b912-f132ed98ab1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:18.445550 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-92170963-1058-4051-b912-f132ed98ab1e None None] MFA Rules not processed for user `21d482a8fa634d40b89786c6e3beb25e`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:18.446829 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-92170963-1058-4051-b912-f132ed98ab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:18.518387 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1410/2802] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:18.530376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bd666-33bf-4f07-9fac-5b6288f41a12 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:18.532128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-0c3bd666-33bf-4f07-9fac-5b6288f41a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:18.593808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bd666-33bf-4f07-9fac-5b6288f41a12 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:18.597586 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3c0d-cd04-4e93-bc30-8cc61239aff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:18.598281 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3c0d-cd04-4e93-bc30-8cc61239aff0 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:18.598569 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3c0d-cd04-4e93-bc30-8cc61239aff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:18.598844 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3c0d-cd04-4e93-bc30-8cc61239aff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:18.664177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e3c0d-cd04-4e93-bc30-8cc61239aff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:18.665815 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e3c0d-cd04-4e93-bc30-8cc61239aff0 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:18.681537 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1393/2803] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:21.268424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92170963-1058-4051-b912-f132ed98ab1e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:21.280015 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92170963-1058-4051-b912-f132ed98ab1e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:21.283573 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54110d-7ef7-4005-ada6-f22400d9bef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:21.284229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54110d-7ef7-4005-ada6-f22400d9bef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:21.284513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54110d-7ef7-4005-ada6-f22400d9bef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:21.284783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54110d-7ef7-4005-ada6-f22400d9bef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:21.295495 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54110d-7ef7-4005-ada6-f22400d9bef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:21.296996 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54110d-7ef7-4005-ada6-f22400d9bef5 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:21.307684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1411/2804] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:28.675827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:31.302585 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=58 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:33.891523 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3c0d-cd04-4e93-bc30-8cc61239aff0 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:33.963696 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3c0d-cd04-4e93-bc30-8cc61239aff0 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:33.968684 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:33.969568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:33.969849 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:33.970149 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] PATH_INFO: `/v3/users/b8123cdd0e074583afa9d45741a0b68c` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:33.971354 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8123cdd0e074583afa9d45741a0b68c)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:33.973258 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:34.027392 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8123cdd0e074583afa9d45741a0b68c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.034519 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8123cdd0e074583afa9d45741a0b68c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.047552 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8123cdd0e074583afa9d45741a0b68c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.050797 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8123cdd0e074583afa9d45741a0b68c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.056971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8123cdd0e074583afa9d45741a0b68c'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.063496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1394/2805] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:33 2022] DELETE /identity/v3/users/b8123cdd0e074583afa9d45741a0b68c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:34.068160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167dd5d-bc6e-478c-a352-09307560869f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:34.068657 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167dd5d-bc6e-478c-a352-09307560869f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:34.068799 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167dd5d-bc6e-478c-a352-09307560869f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:34.086751 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6167dd5d-bc6e-478c-a352-09307560869f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:34.088508 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6167dd5d-bc6e-478c-a352-09307560869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:34.153266 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1412/2806] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:09:34.162936 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:34.164362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:34.231081 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c405b9-05e1-4dce-89b1-cd060b32b6db admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:34.234762 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4783bca-1819-49d5-af5c-b9c5a879a638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:34.235413 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4783bca-1819-49d5-af5c-b9c5a879a638 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:34.235693 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4783bca-1819-49d5-af5c-b9c5a879a638 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:34.235965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4783bca-1819-49d5-af5c-b9c5a879a638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:34.250296 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4783bca-1819-49d5-af5c-b9c5a879a638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:34.251754 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4783bca-1819-49d5-af5c-b9c5a879a638 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:34.262410 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1395/2807] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:34.557415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167dd5d-bc6e-478c-a352-09307560869f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:34.558990 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6167dd5d-bc6e-478c-a352-09307560869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:34.574055 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167dd5d-bc6e-478c-a352-09307560869f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:34.579027 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:34.579930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:34.580825 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:34.581108 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] PATH_INFO: `/v3/projects/6f30b832b6ea4471b25415511bfa2aae` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:34.582699 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f30b832b6ea4471b25415511bfa2aae)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:34.584746 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:34.638033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f30b832b6ea4471b25415511bfa2aae', 'request_id': 'req-9607a120-645c-49d5-b1c4-3f94202d6636'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.646627 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f30b832b6ea4471b25415511bfa2aae', 'request_id': 'req-9607a120-645c-49d5-b1c4-3f94202d6636'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.654397 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f30b832b6ea4471b25415511bfa2aae', 'request_id': 'req-9607a120-645c-49d5-b1c4-3f94202d6636'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.665717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] The token cache is being invalidate because project 6f30b832b6ea4471b25415511bfa2aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:34.666700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.667424 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.668988 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1413/2808] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:34 2022] DELETE /identity/v3/projects/6f30b832b6ea4471b25415511bfa2aae => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:34.673108 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4783bca-1819-49d5-af5c-b9c5a879a638 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:34.683991 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4783bca-1819-49d5-af5c-b9c5a879a638 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:34.704379 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:34.751020 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40678b-06f0-4e0a-be25-094eee17057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:34.751832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40678b-06f0-4e0a-be25-094eee17057c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:34.752114 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40678b-06f0-4e0a-be25-094eee17057c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:34.752391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40678b-06f0-4e0a-be25-094eee17057c admin admin] PATH_INFO: `/v3/users/21d482a8fa634d40b89786c6e3beb25e` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:34.753604 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40678b-06f0-4e0a-be25-094eee17057c admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d482a8fa634d40b89786c6e3beb25e)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:34.755574 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40678b-06f0-4e0a-be25-094eee17057c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:34.806809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4b40678b-06f0-4e0a-be25-094eee17057c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d482a8fa634d40b89786c6e3beb25e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.814121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4b40678b-06f0-4e0a-be25-094eee17057c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d482a8fa634d40b89786c6e3beb25e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.826297 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4b40678b-06f0-4e0a-be25-094eee17057c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d482a8fa634d40b89786c6e3beb25e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.827027 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4b40678b-06f0-4e0a-be25-094eee17057c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d482a8fa634d40b89786c6e3beb25e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.836155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-4b40678b-06f0-4e0a-be25-094eee17057c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d482a8fa634d40b89786c6e3beb25e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:34.844374 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1396/2809] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:34 2022] DELETE /identity/v3/users/21d482a8fa634d40b89786c6e3beb25e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:35.131362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:35.133086 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:35.152033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a120-645c-49d5-b1c4-3f94202d6636 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:35.212295 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:35.213798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:35.214195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:35.214496 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] PATH_INFO: `/v3/projects/e5e98c0a75804e54aea3158cb3466ad5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:35.215752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e98c0a75804e54aea3158cb3466ad5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:35.217684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:35.251340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:35.271112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e98c0a75804e54aea3158cb3466ad5', 'request_id': 'req-b3935ef3-f48c-4bf8-824f-fc6343ee4944'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:35.281623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e98c0a75804e54aea3158cb3466ad5', 'request_id': 'req-b3935ef3-f48c-4bf8-824f-fc6343ee4944'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:35.288828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e98c0a75804e54aea3158cb3466ad5', 'request_id': 'req-b3935ef3-f48c-4bf8-824f-fc6343ee4944'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:35.301597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] The token cache is being invalidate because project e5e98c0a75804e54aea3158cb3466ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:35.301907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:35.302579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b3935ef3-f48c-4bf8-824f-fc6343ee4944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:35.304160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1414/2810] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:35 2022] DELETE /identity/v3/projects/e5e98c0a75804e54aea3158cb3466ad5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:09:35.311938 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba382-0d77-4d59-94de-2c1cdc82e913 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:35.312440 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba382-0d77-4d59-94de-2c1cdc82e913 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:35.312550 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba382-0d77-4d59-94de-2c1cdc82e913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:35.330827 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4fcba382-0d77-4d59-94de-2c1cdc82e913 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:35.332040 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4fcba382-0d77-4d59-94de-2c1cdc82e913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:35.394773 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1397/2811] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:35.402918 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388bc14-8e6f-43df-997f-74ec2a3348fa None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:35.403200 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388bc14-8e6f-43df-997f-74ec2a3348fa None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:35.403477 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388bc14-8e6f-43df-997f-74ec2a3348fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:35.423379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4388bc14-8e6f-43df-997f-74ec2a3348fa None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:35.424594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4388bc14-8e6f-43df-997f-74ec2a3348fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:35.434772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1415/2812] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:35.439167 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcba382-0d77-4d59-94de-2c1cdc82e913 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:35.449904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcba382-0d77-4d59-94de-2c1cdc82e913 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:35.454625 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eb5a2-fc22-4210-a5ef-c72951beb766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:35.455313 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb5a2-fc22-4210-a5ef-c72951beb766 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:35.455582 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb5a2-fc22-4210-a5ef-c72951beb766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:35.455864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb5a2-fc22-4210-a5ef-c72951beb766 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:35.456591 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eb5a2-fc22-4210-a5ef-c72951beb766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:09:35.456904 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eb5a2-fc22-4210-a5ef-c72951beb766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:35.458553 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eb5a2-fc22-4210-a5ef-c72951beb766 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:35.471925 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1398/2813] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:09:35.476435 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388bc14-8e6f-43df-997f-74ec2a3348fa None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:35.487731 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388bc14-8e6f-43df-997f-74ec2a3348fa None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:35.492552 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f875632-cfaf-4f91-89af-12b87ad93a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:35.493220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f875632-cfaf-4f91-89af-12b87ad93a9c admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:35.493502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f875632-cfaf-4f91-89af-12b87ad93a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:35.493773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f875632-cfaf-4f91-89af-12b87ad93a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:35.494511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f875632-cfaf-4f91-89af-12b87ad93a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:35.496432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f875632-cfaf-4f91-89af-12b87ad93a9c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:35.523888 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1416/2814] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:35 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:35.527996 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eb5a2-fc22-4210-a5ef-c72951beb766 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:35.538189 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eb5a2-fc22-4210-a5ef-c72951beb766 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:35.565302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:35.599223 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee476a17-1a05-469e-9804-20dc90a713b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:35.599901 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476a17-1a05-469e-9804-20dc90a713b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:35.600188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476a17-1a05-469e-9804-20dc90a713b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:35.600465 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476a17-1a05-469e-9804-20dc90a713b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:35.601155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee476a17-1a05-469e-9804-20dc90a713b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:35.603122 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee476a17-1a05-469e-9804-20dc90a713b8 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:35.628922 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1399/2815] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:35 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:35.633461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f875632-cfaf-4f91-89af-12b87ad93a9c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:35.644898 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f875632-cfaf-4f91-89af-12b87ad93a9c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:35.649761 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7747d-1239-42da-9ab7-28631b9fcd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:35.650685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7747d-1239-42da-9ab7-28631b9fcd57 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:35.651193 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7747d-1239-42da-9ab7-28631b9fcd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:35.651696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7747d-1239-42da-9ab7-28631b9fcd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:35.652749 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7747d-1239-42da-9ab7-28631b9fcd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:35.654393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7747d-1239-42da-9ab7-28631b9fcd57 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:35.667846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1417/2816] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:35.672036 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee476a17-1a05-469e-9804-20dc90a713b8 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:35.682976 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee476a17-1a05-469e-9804-20dc90a713b8 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:35.687865 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d616e21-f172-4657-a07a-ee5a09a0c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:35.688532 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d616e21-f172-4657-a07a-ee5a09a0c9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:35.688819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d616e21-f172-4657-a07a-ee5a09a0c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:35.689093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d616e21-f172-4657-a07a-ee5a09a0c9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:35.689813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d616e21-f172-4657-a07a-ee5a09a0c9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:35.691455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d616e21-f172-4657-a07a-ee5a09a0c9c6 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:35.703148 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1400/2817] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:35.707504 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7747d-1239-42da-9ab7-28631b9fcd57 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:35.718175 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7747d-1239-42da-9ab7-28631b9fcd57 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:35.722859 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902ee0-5e13-46d4-865f-ea216b04de36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:35.723745 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902ee0-5e13-46d4-865f-ea216b04de36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:35.724022 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902ee0-5e13-46d4-865f-ea216b04de36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:35.724290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902ee0-5e13-46d4-865f-ea216b04de36 admin admin] PATH_INFO: `/v3/projects/eb1ec4169cd24c0eb102ba74fdc8da5b/users/124d6037211443c6bef08a95b08b211b/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:35.742113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902ee0-5e13-46d4-865f-ea216b04de36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1ec4169cd24c0eb102ba74fdc8da5b, user_id=124d6037211443c6bef08a95b08b211b, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:35.745624 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902ee0-5e13-46d4-865f-ea216b04de36 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:35.762565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1418/2818] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:35 2022] PUT /identity/v3/projects/eb1ec4169cd24c0eb102ba74fdc8da5b/users/124d6037211443c6bef08a95b08b211b/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:35.774156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade377b-1b9e-4491-9079-2cfd57ef195b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:35.774363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade377b-1b9e-4491-9079-2cfd57ef195b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:35.774631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade377b-1b9e-4491-9079-2cfd57ef195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:35.802908 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-7ade377b-1b9e-4491-9079-2cfd57ef195b None None] MFA Rules not processed for user `124d6037211443c6bef08a95b08b211b`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:35.804130 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-7ade377b-1b9e-4491-9079-2cfd57ef195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:35.877131 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1401/2819] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:35.882433 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902ee0-5e13-46d4-865f-ea216b04de36 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:35.954856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902ee0-5e13-46d4-865f-ea216b04de36 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:35.959659 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634458e-750b-4b72-abb7-8022b3db7b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:35.960351 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634458e-750b-4b72-abb7-8022b3db7b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:35.960630 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634458e-750b-4b72-abb7-8022b3db7b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:35.960907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634458e-750b-4b72-abb7-8022b3db7b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:35.961606 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634458e-750b-4b72-abb7-8022b3db7b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:35.963928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634458e-750b-4b72-abb7-8022b3db7b48 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:35.990875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1419/2820] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:35 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:35.995869 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade377b-1b9e-4491-9079-2cfd57ef195b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:36.006837 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade377b-1b9e-4491-9079-2cfd57ef195b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:36.066218 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0ab76-b972-40a7-9939-efb57c01e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:36.066806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0ab76-b972-40a7-9939-efb57c01e810 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:36.067093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0ab76-b972-40a7-9939-efb57c01e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:36.067373 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0ab76-b972-40a7-9939-efb57c01e810 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:36.068070 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0ab76-b972-40a7-9939-efb57c01e810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:36.070031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0ab76-b972-40a7-9939-efb57c01e810 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:36.097829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1402/2821] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:35 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:36.102118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634458e-750b-4b72-abb7-8022b3db7b48 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:36.112827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634458e-750b-4b72-abb7-8022b3db7b48 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:36.117559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a19fa3-e965-42e9-92aa-44a372b8584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:36.118265 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19fa3-e965-42e9-92aa-44a372b8584b admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:36.118547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19fa3-e965-42e9-92aa-44a372b8584b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:36.118824 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19fa3-e965-42e9-92aa-44a372b8584b admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:36.119743 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19fa3-e965-42e9-92aa-44a372b8584b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:36.121556 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19fa3-e965-42e9-92aa-44a372b8584b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:36.133374 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1420/2822] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:36.138461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0ab76-b972-40a7-9939-efb57c01e810 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:36.149116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0ab76-b972-40a7-9939-efb57c01e810 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:36.154986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7fe8e-7e16-4197-a93b-291aeecc414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:36.155892 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7fe8e-7e16-4197-a93b-291aeecc414f admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:36.156183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7fe8e-7e16-4197-a93b-291aeecc414f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:36.156461 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7fe8e-7e16-4197-a93b-291aeecc414f admin admin] PATH_INFO: `/v3/projects/3baa9ac91ac74f928775a93a99b3f386/users/9ed3f44b664c4f9dac308a0091347e4f/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:36.174574 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7fe8e-7e16-4197-a93b-291aeecc414f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3baa9ac91ac74f928775a93a99b3f386, user_id=9ed3f44b664c4f9dac308a0091347e4f, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:36.177254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7fe8e-7e16-4197-a93b-291aeecc414f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:36.192207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1403/2823] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:36 2022] PUT /identity/v3/projects/3baa9ac91ac74f928775a93a99b3f386/users/9ed3f44b664c4f9dac308a0091347e4f/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:36.196440 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a19fa3-e965-42e9-92aa-44a372b8584b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:36.207759 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a19fa3-e965-42e9-92aa-44a372b8584b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:36.228752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:36.272246 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c3ae-7a3f-4215-a94f-2d36c83398e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:36.272827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c3ae-7a3f-4215-a94f-2d36c83398e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:36.273117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c3ae-7a3f-4215-a94f-2d36c83398e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:36.273396 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c3ae-7a3f-4215-a94f-2d36c83398e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:36.274166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032c3ae-7a3f-4215-a94f-2d36c83398e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:36.276426 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032c3ae-7a3f-4215-a94f-2d36c83398e2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:36.287527 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1421/2824] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:36.291054 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7fe8e-7e16-4197-a93b-291aeecc414f admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:36.297247 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:36.303815 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7fe8e-7e16-4197-a93b-291aeecc414f admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:36.310740 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db614a34-b67d-4656-b609-3d4360e9583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:36.311644 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614a34-b67d-4656-b609-3d4360e9583c admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:36.311923 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614a34-b67d-4656-b609-3d4360e9583c admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:36.312197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614a34-b67d-4656-b609-3d4360e9583c admin admin] PATH_INFO: `/v3/projects/3baa9ac91ac74f928775a93a99b3f386/users/9ed3f44b664c4f9dac308a0091347e4f/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:36.314265 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db614a34-b67d-4656-b609-3d4360e9583c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3baa9ac91ac74f928775a93a99b3f386, user_id=9ed3f44b664c4f9dac308a0091347e4f, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:36.316983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db614a34-b67d-4656-b609-3d4360e9583c admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:36.328890 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1404/2825] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:36 2022] PUT /identity/v3/projects/3baa9ac91ac74f928775a93a99b3f386/users/9ed3f44b664c4f9dac308a0091347e4f/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:36.339453 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894ba86-4a21-42a1-8c9f-30cc98ca4d57 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:36.339748 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894ba86-4a21-42a1-8c9f-30cc98ca4d57 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:36.340026 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894ba86-4a21-42a1-8c9f-30cc98ca4d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:36.367227 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4894ba86-4a21-42a1-8c9f-30cc98ca4d57 None None] MFA Rules not processed for user `9ed3f44b664c4f9dac308a0091347e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:36.368451 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4894ba86-4a21-42a1-8c9f-30cc98ca4d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:36.441099 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1422/2826] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:36.453265 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db614a34-b67d-4656-b609-3d4360e9583c admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:36.455028 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-db614a34-b67d-4656-b609-3d4360e9583c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:36.518429 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db614a34-b67d-4656-b609-3d4360e9583c admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:36.522286 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc089-a151-4e8e-a01a-58000bd48894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:36.523006 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc089-a151-4e8e-a01a-58000bd48894 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:36.523336 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc089-a151-4e8e-a01a-58000bd48894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:36.523658 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc089-a151-4e8e-a01a-58000bd48894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:36.534271 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bc089-a151-4e8e-a01a-58000bd48894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:36.535733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bc089-a151-4e8e-a01a-58000bd48894 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:36.546412 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1405/2827] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:36.595711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894ba86-4a21-42a1-8c9f-30cc98ca4d57 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:36.597124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4894ba86-4a21-42a1-8c9f-30cc98ca4d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:36.610289 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894ba86-4a21-42a1-8c9f-30cc98ca4d57 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:36.613950 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956bac9-5655-44a9-99f8-18a6c45c23a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:36.614610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956bac9-5655-44a9-99f8-18a6c45c23a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:36.614924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956bac9-5655-44a9-99f8-18a6c45c23a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:36.615202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956bac9-5655-44a9-99f8-18a6c45c23a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:36.680036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956bac9-5655-44a9-99f8-18a6c45c23a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:36.681539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956bac9-5655-44a9-99f8-18a6c45c23a2 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:36.691432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1423/2828] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:40.016981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc089-a151-4e8e-a01a-58000bd48894 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:40.084746 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc089-a151-4e8e-a01a-58000bd48894 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:40.090368 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:40.091246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:40.091525 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:40.091800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] PATH_INFO: `/v3/users/124d6037211443c6bef08a95b08b211b` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:40.093043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=124d6037211443c6bef08a95b08b211b)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:40.095156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:40.147254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124d6037211443c6bef08a95b08b211b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.155345 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124d6037211443c6bef08a95b08b211b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.171138 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124d6037211443c6bef08a95b08b211b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.172185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124d6037211443c6bef08a95b08b211b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.182311 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124d6037211443c6bef08a95b08b211b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.189897 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1406/2829] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:40 2022] DELETE /identity/v3/users/124d6037211443c6bef08a95b08b211b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:40.194649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354eba-145a-402e-b87c-9e2c3a6105de None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:40.195167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354eba-145a-402e-b87c-9e2c3a6105de None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:40.195276 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354eba-145a-402e-b87c-9e2c3a6105de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:40.213184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d1354eba-145a-402e-b87c-9e2c3a6105de None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:40.215003 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d1354eba-145a-402e-b87c-9e2c3a6105de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:40.257336 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:40.277851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1424/2830] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:09:40.287749 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:40.289197 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:40.303892 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:40.356993 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f052c-4b4a-49df-9048-f634e8f61dee admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:40.360808 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01a279-6264-43e8-ad5d-cf22c9ea7a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:40.361472 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01a279-6264-43e8-ad5d-cf22c9ea7a6f service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:40.361758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01a279-6264-43e8-ad5d-cf22c9ea7a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:40.362069 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01a279-6264-43e8-ad5d-cf22c9ea7a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:40.371999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01a279-6264-43e8-ad5d-cf22c9ea7a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:40.373452 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01a279-6264-43e8-ad5d-cf22c9ea7a6f service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:40.383878 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1407/2831] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:40.669129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1354eba-145a-402e-b87c-9e2c3a6105de None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:40.670718 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d1354eba-145a-402e-b87c-9e2c3a6105de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:40.685538 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1354eba-145a-402e-b87c-9e2c3a6105de None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:40.691391 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:40.692278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:40.692559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:40.692856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] PATH_INFO: `/v3/projects/eb1ec4169cd24c0eb102ba74fdc8da5b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:40.694134 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1ec4169cd24c0eb102ba74fdc8da5b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:40.696051 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:40.757127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1ec4169cd24c0eb102ba74fdc8da5b', 'request_id': 'req-9b154d5d-8c77-4161-9f2b-94d8669d6300'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.766956 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1ec4169cd24c0eb102ba74fdc8da5b', 'request_id': 'req-9b154d5d-8c77-4161-9f2b-94d8669d6300'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.774142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1ec4169cd24c0eb102ba74fdc8da5b', 'request_id': 'req-9b154d5d-8c77-4161-9f2b-94d8669d6300'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.789154 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] The token cache is being invalidate because project eb1ec4169cd24c0eb102ba74fdc8da5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:40.789511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.790598 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.793613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1425/2832] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:40 2022] DELETE /identity/v3/projects/eb1ec4169cd24c0eb102ba74fdc8da5b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:40.797662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01a279-6264-43e8-ad5d-cf22c9ea7a6f service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:40.808653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01a279-6264-43e8-ad5d-cf22c9ea7a6f service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:40.871475 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8155b1f-4080-425e-8a8d-3e2b39099c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:40.871760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8155b1f-4080-425e-8a8d-3e2b39099c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:40.872030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8155b1f-4080-425e-8a8d-3e2b39099c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:40.872312 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8155b1f-4080-425e-8a8d-3e2b39099c16 admin admin] PATH_INFO: `/v3/users/9ed3f44b664c4f9dac308a0091347e4f` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:40.873576 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8155b1f-4080-425e-8a8d-3e2b39099c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed3f44b664c4f9dac308a0091347e4f)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:40.875555 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8155b1f-4080-425e-8a8d-3e2b39099c16 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:40.935356 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a8155b1f-4080-425e-8a8d-3e2b39099c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed3f44b664c4f9dac308a0091347e4f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.942627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a8155b1f-4080-425e-8a8d-3e2b39099c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed3f44b664c4f9dac308a0091347e4f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.959584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a8155b1f-4080-425e-8a8d-3e2b39099c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed3f44b664c4f9dac308a0091347e4f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.960316 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a8155b1f-4080-425e-8a8d-3e2b39099c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed3f44b664c4f9dac308a0091347e4f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.969307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-a8155b1f-4080-425e-8a8d-3e2b39099c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed3f44b664c4f9dac308a0091347e4f'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:40.987212 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1408/2833] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:40 2022] DELETE /identity/v3/users/9ed3f44b664c4f9dac308a0091347e4f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:41.292790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:41.294332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:41.309307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154d5d-8c77-4161-9f2b-94d8669d6300 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:41.369857 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:41.370783 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:41.371063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:41.371341 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] PATH_INFO: `/v3/projects/3baa9ac91ac74f928775a93a99b3f386` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:41.374113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3baa9ac91ac74f928775a93a99b3f386)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:41.376273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:41.430456 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3baa9ac91ac74f928775a93a99b3f386', 'request_id': 'req-11c06505-e43c-4e3d-86e0-bb290d638be8'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:41.439663 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3baa9ac91ac74f928775a93a99b3f386', 'request_id': 'req-11c06505-e43c-4e3d-86e0-bb290d638be8'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:41.447557 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3baa9ac91ac74f928775a93a99b3f386', 'request_id': 'req-11c06505-e43c-4e3d-86e0-bb290d638be8'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:41.453913 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:41.458478 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] The token cache is being invalidate because project 3baa9ac91ac74f928775a93a99b3f386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:41.459180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:41.459931 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-11c06505-e43c-4e3d-86e0-bb290d638be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:41.461619 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1426/2834] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:41 2022] DELETE /identity/v3/projects/3baa9ac91ac74f928775a93a99b3f386 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:41.468294 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a5fe0-0faf-479d-84a9-717f5e53df8b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:41.468812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a5fe0-0faf-479d-84a9-717f5e53df8b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:41.469037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a5fe0-0faf-479d-84a9-717f5e53df8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:41.492397 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-476a5fe0-0faf-479d-84a9-717f5e53df8b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:41.493673 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-476a5fe0-0faf-479d-84a9-717f5e53df8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:41.528694 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:41.566513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1409/2835] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:41.576230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41711767-3cf1-4ddf-94a3-3f5a4d80a36f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:41.576517 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41711767-3cf1-4ddf-94a3-3f5a4d80a36f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:41.576797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41711767-3cf1-4ddf-94a3-3f5a4d80a36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:41.596982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-41711767-3cf1-4ddf-94a3-3f5a4d80a36f None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:41.598255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-41711767-3cf1-4ddf-94a3-3f5a4d80a36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:41.607298 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1427/2836] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:41.611649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a5fe0-0faf-479d-84a9-717f5e53df8b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:41.621689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a5fe0-0faf-479d-84a9-717f5e53df8b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:41.626327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5d970-83ce-4fc4-802c-cc1cc812e4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:41.626995 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5d970-83ce-4fc4-802c-cc1cc812e4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:41.627275 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5d970-83ce-4fc4-802c-cc1cc812e4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:41.627549 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5d970-83ce-4fc4-802c-cc1cc812e4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:41.628268 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5d970-83ce-4fc4-802c-cc1cc812e4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:09:41.628572 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5d970-83ce-4fc4-802c-cc1cc812e4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:41.630192 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5d970-83ce-4fc4-802c-cc1cc812e4f0 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:41.643298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1410/2837] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:09:41.647852 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41711767-3cf1-4ddf-94a3-3f5a4d80a36f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:41.657983 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41711767-3cf1-4ddf-94a3-3f5a4d80a36f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:41.662798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd58b1-7f0c-4e34-9834-a9303b0a34de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:41.663476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd58b1-7f0c-4e34-9834-a9303b0a34de admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:41.663856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd58b1-7f0c-4e34-9834-a9303b0a34de admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:41.663992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd58b1-7f0c-4e34-9834-a9303b0a34de admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:41.664701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd58b1-7f0c-4e34-9834-a9303b0a34de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:41.667274 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd58b1-7f0c-4e34-9834-a9303b0a34de admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:41.694610 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1428/2838] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:41 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:41.699301 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5d970-83ce-4fc4-802c-cc1cc812e4f0 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:41.709270 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5d970-83ce-4fc4-802c-cc1cc812e4f0 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:41.782751 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b1968-4dbc-4467-89b0-c88f08dfa461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:41.783421 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b1968-4dbc-4467-89b0-c88f08dfa461 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:41.783700 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b1968-4dbc-4467-89b0-c88f08dfa461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:41.783971 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b1968-4dbc-4467-89b0-c88f08dfa461 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:41.784715 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b1968-4dbc-4467-89b0-c88f08dfa461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:41.786602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b1968-4dbc-4467-89b0-c88f08dfa461 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:41.811196 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1411/2839] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:41 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:41.812708 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd58b1-7f0c-4e34-9834-a9303b0a34de admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:41.823802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd58b1-7f0c-4e34-9834-a9303b0a34de admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:41.829081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e59da-8795-4d27-8c74-8b72a5e47242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:41.829820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e59da-8795-4d27-8c74-8b72a5e47242 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:41.830061 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e59da-8795-4d27-8c74-8b72a5e47242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:41.830332 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e59da-8795-4d27-8c74-8b72a5e47242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:41.831056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e59da-8795-4d27-8c74-8b72a5e47242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:41.832649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e59da-8795-4d27-8c74-8b72a5e47242 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:41.845439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1429/2840] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:41.849430 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b1968-4dbc-4467-89b0-c88f08dfa461 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:41.859887 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b1968-4dbc-4467-89b0-c88f08dfa461 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:41.868690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5eee75-6088-44fa-9910-110317931bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:41.869455 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eee75-6088-44fa-9910-110317931bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:41.869745 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eee75-6088-44fa-9910-110317931bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:41.870060 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eee75-6088-44fa-9910-110317931bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:41.870828 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5eee75-6088-44fa-9910-110317931bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:41.872485 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5eee75-6088-44fa-9910-110317931bd7 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:41.883172 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1412/2841] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:09:41.887894 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e59da-8795-4d27-8c74-8b72a5e47242 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:41.897729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e59da-8795-4d27-8c74-8b72a5e47242 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:41.903135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8704d3-a0d6-401f-85af-3218d4b67afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:41.904018 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8704d3-a0d6-401f-85af-3218d4b67afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:41.904307 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8704d3-a0d6-401f-85af-3218d4b67afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:41.904584 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8704d3-a0d6-401f-85af-3218d4b67afe admin admin] PATH_INFO: `/v3/projects/30c55fab056d4cb7a4d7d71b5126d70d/users/870edb46629341ca8429248bc4c5e25d/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:41.918979 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8704d3-a0d6-401f-85af-3218d4b67afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c55fab056d4cb7a4d7d71b5126d70d, user_id=870edb46629341ca8429248bc4c5e25d, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:41.921685 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8704d3-a0d6-401f-85af-3218d4b67afe admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:41.937127 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1430/2842] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:41 2022] PUT /identity/v3/projects/30c55fab056d4cb7a4d7d71b5126d70d/users/870edb46629341ca8429248bc4c5e25d/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:41.948175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17627d-6be3-46d5-9953-955778e4830a None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:41.948651 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17627d-6be3-46d5-9953-955778e4830a None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:41.948786 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17627d-6be3-46d5-9953-955778e4830a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:41.978610 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ee17627d-6be3-46d5-9953-955778e4830a None None] MFA Rules not processed for user `870edb46629341ca8429248bc4c5e25d`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:41.979886 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ee17627d-6be3-46d5-9953-955778e4830a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:42.048907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1413/2843] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:42.060354 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8704d3-a0d6-401f-85af-3218d4b67afe admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:42.062166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2e8704d3-a0d6-401f-85af-3218d4b67afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:42.121140 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8704d3-a0d6-401f-85af-3218d4b67afe admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:42.125136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb1260-caff-41b5-82fe-d08de85af194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:42.125739 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1260-caff-41b5-82fe-d08de85af194 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:42.126063 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1260-caff-41b5-82fe-d08de85af194 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:42.126337 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1260-caff-41b5-82fe-d08de85af194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:42.136846 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb1260-caff-41b5-82fe-d08de85af194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:42.138388 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb1260-caff-41b5-82fe-d08de85af194 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:42.147955 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1431/2844] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:45.212684 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17627d-6be3-46d5-9953-955778e4830a None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:45.245639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:45.282528 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17627d-6be3-46d5-9953-955778e4830a None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:45.289203 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:45.290590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:45.291005 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:45.291415 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] PATH_INFO: `/v3/users/870edb46629341ca8429248bc4c5e25d` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:45.293317 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870edb46629341ca8429248bc4c5e25d)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:45.296538 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:45.358298 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870edb46629341ca8429248bc4c5e25d'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:45.367067 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870edb46629341ca8429248bc4c5e25d'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:45.380242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870edb46629341ca8429248bc4c5e25d'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:45.380975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870edb46629341ca8429248bc4c5e25d'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:45.390264 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870edb46629341ca8429248bc4c5e25d'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:45.397308 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1414/2845] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:45 2022] DELETE /identity/v3/users/870edb46629341ca8429248bc4c5e25d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:45.402393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82add8-3d87-4f3c-9066-1a5932feff71 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:45.403184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82add8-3d87-4f3c-9066-1a5932feff71 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:45.403184 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82add8-3d87-4f3c-9066-1a5932feff71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:45.420513 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fa82add8-3d87-4f3c-9066-1a5932feff71 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:45.421755 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fa82add8-3d87-4f3c-9066-1a5932feff71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:45.487167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1432/2846] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:45.497705 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:45.499184 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:45.560193 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439b73c-db2d-4770-a196-5fc1972fc938 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:45.564119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58140b73-0298-48e9-b5a9-fe152dd8aebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:45.564773 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58140b73-0298-48e9-b5a9-fe152dd8aebe service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:45.565095 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58140b73-0298-48e9-b5a9-fe152dd8aebe service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:45.565411 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58140b73-0298-48e9-b5a9-fe152dd8aebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:45.578687 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58140b73-0298-48e9-b5a9-fe152dd8aebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:45.580133 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58140b73-0298-48e9-b5a9-fe152dd8aebe service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:45.590734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1415/2847] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:45.887095 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82add8-3d87-4f3c-9066-1a5932feff71 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:45.889160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fa82add8-3d87-4f3c-9066-1a5932feff71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:45.902396 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82add8-3d87-4f3c-9066-1a5932feff71 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:45.907407 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:45.908305 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:45.908579 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:45.908861 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] PATH_INFO: `/v3/projects/30c55fab056d4cb7a4d7d71b5126d70d` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:45.910961 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=30c55fab056d4cb7a4d7d71b5126d70d)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:45.912889 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:45.956224 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:45.971198 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c55fab056d4cb7a4d7d71b5126d70d', 'request_id': 'req-d5f0e123-a4df-4669-b2a7-e823560d5f4c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:45.980032 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c55fab056d4cb7a4d7d71b5126d70d', 'request_id': 'req-d5f0e123-a4df-4669-b2a7-e823560d5f4c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:45.987850 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c55fab056d4cb7a4d7d71b5126d70d', 'request_id': 'req-d5f0e123-a4df-4669-b2a7-e823560d5f4c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:45.999319 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] The token cache is being invalidate because project 30c55fab056d4cb7a4d7d71b5126d70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:45.999790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:46.000840 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d5f0e123-a4df-4669-b2a7-e823560d5f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:46.003793 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1433/2848] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:45 2022] DELETE /identity/v3/projects/30c55fab056d4cb7a4d7d71b5126d70d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:46.011416 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2979c-83ef-4494-9ac8-dbbc92daeb53 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.011829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2979c-83ef-4494-9ac8-dbbc92daeb53 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.012119 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2979c-83ef-4494-9ac8-dbbc92daeb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.030860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-caa2979c-83ef-4494-9ac8-dbbc92daeb53 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:46.032092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-caa2979c-83ef-4494-9ac8-dbbc92daeb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:46.094452 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:46.111623 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1416/2849] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:46.120202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f339e-ab5e-4199-9a5e-14989ff0d381 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.120476 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f339e-ab5e-4199-9a5e-14989ff0d381 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.120756 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f339e-ab5e-4199-9a5e-14989ff0d381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.139907 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9a3f339e-ab5e-4199-9a5e-14989ff0d381 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:46.141135 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9a3f339e-ab5e-4199-9a5e-14989ff0d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:46.149115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1434/2850] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:09:46.154619 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2979c-83ef-4494-9ac8-dbbc92daeb53 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.164946 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2979c-83ef-4494-9ac8-dbbc92daeb53 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.170400 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4181d10-5673-4b23-83d5-c999dd5d45e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.171100 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181d10-5673-4b23-83d5-c999dd5d45e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.171387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181d10-5673-4b23-83d5-c999dd5d45e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.171667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181d10-5673-4b23-83d5-c999dd5d45e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.172394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4181d10-5673-4b23-83d5-c999dd5d45e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80108) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:09:46.172703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4181d10-5673-4b23-83d5-c999dd5d45e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.174362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4181d10-5673-4b23-83d5-c999dd5d45e9 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.187407 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1417/2851] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:09:46.191856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f339e-ab5e-4199-9a5e-14989ff0d381 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.202145 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f339e-ab5e-4199-9a5e-14989ff0d381 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.206910 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15955575-0535-45f9-a02e-37d876d21574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.207575 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955575-0535-45f9-a02e-37d876d21574 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.207854 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955575-0535-45f9-a02e-37d876d21574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.208150 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955575-0535-45f9-a02e-37d876d21574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.208833 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15955575-0535-45f9-a02e-37d876d21574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.210752 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15955575-0535-45f9-a02e-37d876d21574 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.239073 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1435/2852] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:46 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:09:46.242950 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4181d10-5673-4b23-83d5-c999dd5d45e9 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.253819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4181d10-5673-4b23-83d5-c999dd5d45e9 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.313466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e5f7-de22-4c89-a25e-1383f587fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.314181 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e5f7-de22-4c89-a25e-1383f587fa82 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.314466 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e5f7-de22-4c89-a25e-1383f587fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.314744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e5f7-de22-4c89-a25e-1383f587fa82 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.315448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82e5f7-de22-4c89-a25e-1383f587fa82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.317401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82e5f7-de22-4c89-a25e-1383f587fa82 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.342862 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1418/2853] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:46 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:09:46.347113 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15955575-0535-45f9-a02e-37d876d21574 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.357994 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15955575-0535-45f9-a02e-37d876d21574 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.362966 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04562dea-2546-4502-9b8b-ebdd7fb28614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.363670 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04562dea-2546-4502-9b8b-ebdd7fb28614 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.363939 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04562dea-2546-4502-9b8b-ebdd7fb28614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.364220 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04562dea-2546-4502-9b8b-ebdd7fb28614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.364960 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04562dea-2546-4502-9b8b-ebdd7fb28614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.366625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04562dea-2546-4502-9b8b-ebdd7fb28614 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.378448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1436/2854] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:09:46.383677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e5f7-de22-4c89-a25e-1383f587fa82 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.395245 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e5f7-de22-4c89-a25e-1383f587fa82 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.400714 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273648e-7e8d-4b73-8263-09a508ec2496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.402120 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273648e-7e8d-4b73-8263-09a508ec2496 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.402616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273648e-7e8d-4b73-8263-09a508ec2496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.403139 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273648e-7e8d-4b73-8263-09a508ec2496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.404577 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273648e-7e8d-4b73-8263-09a508ec2496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.406561 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273648e-7e8d-4b73-8263-09a508ec2496 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.417666 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1419/2855] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:46.421869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04562dea-2546-4502-9b8b-ebdd7fb28614 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.432512 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04562dea-2546-4502-9b8b-ebdd7fb28614 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.437291 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcaad1-4bc9-4790-a940-8bb2eacf04e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.438230 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcaad1-4bc9-4790-a940-8bb2eacf04e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.438516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcaad1-4bc9-4790-a940-8bb2eacf04e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.438801 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcaad1-4bc9-4790-a940-8bb2eacf04e9 admin admin] PATH_INFO: `/v3/projects/93ec77fa6bb045258c464d64dd779690/users/d8616e61d0fd460d88cf91801e338ac4/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.455948 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcaad1-4bc9-4790-a940-8bb2eacf04e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ec77fa6bb045258c464d64dd779690, user_id=d8616e61d0fd460d88cf91801e338ac4, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.458751 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcaad1-4bc9-4790-a940-8bb2eacf04e9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.473645 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1437/2856] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:46 2022] PUT /identity/v3/projects/93ec77fa6bb045258c464d64dd779690/users/d8616e61d0fd460d88cf91801e338ac4/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:46.486676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93cec3-8924-4c20-8ce1-f0e1dcfdb824 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.487144 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93cec3-8924-4c20-8ce1-f0e1dcfdb824 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.487641 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93cec3-8924-4c20-8ce1-f0e1dcfdb824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.524968 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-eb93cec3-8924-4c20-8ce1-f0e1dcfdb824 None None] MFA Rules not processed for user `d8616e61d0fd460d88cf91801e338ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:46.526577 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-eb93cec3-8924-4c20-8ce1-f0e1dcfdb824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:46.598751 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1420/2857] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:46.603461 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcaad1-4bc9-4790-a940-8bb2eacf04e9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.669734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcaad1-4bc9-4790-a940-8bb2eacf04e9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.674792 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec8b20-ce6c-4ba7-a627-5027a6ffbc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.675460 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec8b20-ce6c-4ba7-a627-5027a6ffbc02 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.675832 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec8b20-ce6c-4ba7-a627-5027a6ffbc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.676280 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec8b20-ce6c-4ba7-a627-5027a6ffbc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.677109 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec8b20-ce6c-4ba7-a627-5027a6ffbc02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.679068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec8b20-ce6c-4ba7-a627-5027a6ffbc02 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.709159 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1438/2858] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:46 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:46.713157 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93cec3-8924-4c20-8ce1-f0e1dcfdb824 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.724183 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93cec3-8924-4c20-8ce1-f0e1dcfdb824 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.773920 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:46.788981 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223def06-2bfd-45ff-8c90-8ae468730c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.789578 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223def06-2bfd-45ff-8c90-8ae468730c96 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.789860 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223def06-2bfd-45ff-8c90-8ae468730c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.790174 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223def06-2bfd-45ff-8c90-8ae468730c96 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.791554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223def06-2bfd-45ff-8c90-8ae468730c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.793515 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223def06-2bfd-45ff-8c90-8ae468730c96 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.814975 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1421/2859] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:46 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:09:46.819173 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec8b20-ce6c-4ba7-a627-5027a6ffbc02 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.832182 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec8b20-ce6c-4ba7-a627-5027a6ffbc02 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.837647 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd7919-45ee-4434-b82f-c968c2cf7f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.838621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7919-45ee-4434-b82f-c968c2cf7f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.838903 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7919-45ee-4434-b82f-c968c2cf7f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.839189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7919-45ee-4434-b82f-c968c2cf7f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.839911 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd7919-45ee-4434-b82f-c968c2cf7f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.841525 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd7919-45ee-4434-b82f-c968c2cf7f22 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.852851 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1439/2860] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:46.857043 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223def06-2bfd-45ff-8c90-8ae468730c96 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.869427 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223def06-2bfd-45ff-8c90-8ae468730c96 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.875123 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e92cc4-295d-4844-97b8-a8fe48c02152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.875819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e92cc4-295d-4844-97b8-a8fe48c02152 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.876107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e92cc4-295d-4844-97b8-a8fe48c02152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.876387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e92cc4-295d-4844-97b8-a8fe48c02152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.877117 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e92cc4-295d-4844-97b8-a8fe48c02152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.878761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e92cc4-295d-4844-97b8-a8fe48c02152 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.890960 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1422/2861] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:46.895203 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd7919-45ee-4434-b82f-c968c2cf7f22 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.906151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd7919-45ee-4434-b82f-c968c2cf7f22 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.910928 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedff91-64ee-4a41-a9c9-ce05a678e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.911827 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedff91-64ee-4a41-a9c9-ce05a678e25c admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.912115 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedff91-64ee-4a41-a9c9-ce05a678e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.912393 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedff91-64ee-4a41-a9c9-ce05a678e25c admin admin] PATH_INFO: `/v3/projects/316b40e2e3ce485c93d222a6a9381a5a/users/a770d00cbebe4992ad4e443d9d2003e6/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.928201 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedff91-64ee-4a41-a9c9-ce05a678e25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=316b40e2e3ce485c93d222a6a9381a5a, user_id=a770d00cbebe4992ad4e443d9d2003e6, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.930972 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedff91-64ee-4a41-a9c9-ce05a678e25c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.948368 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1440/2862] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:46 2022] PUT /identity/v3/projects/316b40e2e3ce485c93d222a6a9381a5a/users/a770d00cbebe4992ad4e443d9d2003e6/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:46.962912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633acc43-4134-4e18-962b-c3194b9d03b0 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.963342 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633acc43-4134-4e18-962b-c3194b9d03b0 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.963653 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633acc43-4134-4e18-962b-c3194b9d03b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.991681 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-633acc43-4134-4e18-962b-c3194b9d03b0 None None] MFA Rules not processed for user `a770d00cbebe4992ad4e443d9d2003e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:46.992924 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-633acc43-4134-4e18-962b-c3194b9d03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:47.070760 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1423/2863] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:47.076067 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedff91-64ee-4a41-a9c9-ce05a678e25c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:47.085143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:47.144082 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedff91-64ee-4a41-a9c9-ce05a678e25c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:47.148775 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a019140-382e-433e-939e-1d6ef3292ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:47.149448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019140-382e-433e-939e-1d6ef3292ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:47.149735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019140-382e-433e-939e-1d6ef3292ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:47.150608 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019140-382e-433e-939e-1d6ef3292ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:47.151711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a019140-382e-433e-939e-1d6ef3292ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:47.153637 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a019140-382e-433e-939e-1d6ef3292ebe admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:47.183219 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1441/2864] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:47 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:09:47.187377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633acc43-4134-4e18-962b-c3194b9d03b0 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:47.199107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633acc43-4134-4e18-962b-c3194b9d03b0 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:47.261295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb6b2d-65e4-4798-8688-a4ec58c6e620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:47.262024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb6b2d-65e4-4798-8688-a4ec58c6e620 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:47.262291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb6b2d-65e4-4798-8688-a4ec58c6e620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:47.262621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb6b2d-65e4-4798-8688-a4ec58c6e620 admin admin] PATH_INFO: `/v3/users` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:47.263441 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb6b2d-65e4-4798-8688-a4ec58c6e620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:47.265388 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb6b2d-65e4-4798-8688-a4ec58c6e620 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:47.289819 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1424/2865] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:47 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:47.291565 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a019140-382e-433e-939e-1d6ef3292ebe admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:47.302124 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a019140-382e-433e-939e-1d6ef3292ebe admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:47.306959 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de728fe2-a13f-45ec-a3dc-c41cb256d075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:47.307636 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de728fe2-a13f-45ec-a3dc-c41cb256d075 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:47.307921 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de728fe2-a13f-45ec-a3dc-c41cb256d075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:47.308196 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de728fe2-a13f-45ec-a3dc-c41cb256d075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:47.308924 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de728fe2-a13f-45ec-a3dc-c41cb256d075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:47.310577 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de728fe2-a13f-45ec-a3dc-c41cb256d075 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:47.322583 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1442/2866] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:09:47.326832 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb6b2d-65e4-4798-8688-a4ec58c6e620 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:47.338983 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb6b2d-65e4-4798-8688-a4ec58c6e620 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:47.343855 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf58a0b-2078-4305-a26c-df22b58c8bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:47.344751 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf58a0b-2078-4305-a26c-df22b58c8bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:47.345032 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf58a0b-2078-4305-a26c-df22b58c8bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:47.345304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf58a0b-2078-4305-a26c-df22b58c8bf3 admin admin] PATH_INFO: `/v3/projects/b2def4d2efc9454e9a6a51123cb15a61/users/98e2e898db744b9899cfa3f5fd581495/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:47.367624 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf58a0b-2078-4305-a26c-df22b58c8bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2def4d2efc9454e9a6a51123cb15a61, user_id=98e2e898db744b9899cfa3f5fd581495, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:47.372434 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf58a0b-2078-4305-a26c-df22b58c8bf3 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:47.387521 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1425/2867] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:47 2022] PUT /identity/v3/projects/b2def4d2efc9454e9a6a51123cb15a61/users/98e2e898db744b9899cfa3f5fd581495/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:09:47.391658 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de728fe2-a13f-45ec-a3dc-c41cb256d075 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:47.403601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de728fe2-a13f-45ec-a3dc-c41cb256d075 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:47.466079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1a5c3-b256-4075-9b21-a73f16cd8d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:47.466782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1a5c3-b256-4075-9b21-a73f16cd8d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:47.467036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1a5c3-b256-4075-9b21-a73f16cd8d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:47.467306 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1a5c3-b256-4075-9b21-a73f16cd8d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:47.468036 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1a5c3-b256-4075-9b21-a73f16cd8d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:47.469635 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1a5c3-b256-4075-9b21-a73f16cd8d7f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:47.481449 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1443/2868] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:09:47.485809 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf58a0b-2078-4305-a26c-df22b58c8bf3 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:47.496491 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf58a0b-2078-4305-a26c-df22b58c8bf3 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:47.501287 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a6a19-e719-4da1-9f77-78ae52f50bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:47.502217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6a19-e719-4da1-9f77-78ae52f50bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:47.502505 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6a19-e719-4da1-9f77-78ae52f50bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:47.502788 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6a19-e719-4da1-9f77-78ae52f50bbd admin admin] PATH_INFO: `/v3/projects/b2def4d2efc9454e9a6a51123cb15a61/users/98e2e898db744b9899cfa3f5fd581495/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:47.504812 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a6a19-e719-4da1-9f77-78ae52f50bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2def4d2efc9454e9a6a51123cb15a61, user_id=98e2e898db744b9899cfa3f5fd581495, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:47.507776 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a6a19-e719-4da1-9f77-78ae52f50bbd admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:47.518690 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1426/2869] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:47 2022] PUT /identity/v3/projects/b2def4d2efc9454e9a6a51123cb15a61/users/98e2e898db744b9899cfa3f5fd581495/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:47.530730 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58db3-3063-4580-8c33-ba1d1447a07a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:47.531024 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58db3-3063-4580-8c33-ba1d1447a07a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:47.531303 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58db3-3063-4580-8c33-ba1d1447a07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:47.560414 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-47a58db3-3063-4580-8c33-ba1d1447a07a None None] MFA Rules not processed for user `98e2e898db744b9899cfa3f5fd581495`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:47.561650 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-47a58db3-3063-4580-8c33-ba1d1447a07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:47.632576 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1444/2870] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:47.647267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a6a19-e719-4da1-9f77-78ae52f50bbd admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:47.649019 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-fb0a6a19-e719-4da1-9f77-78ae52f50bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:47.662663 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:47.717643 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a6a19-e719-4da1-9f77-78ae52f50bbd admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:47.725701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369e00e-3c53-4685-9fbf-d8a15994c368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:47.731188 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e00e-3c53-4685-9fbf-d8a15994c368 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:47.731490 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e00e-3c53-4685-9fbf-d8a15994c368 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:47.731767 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e00e-3c53-4685-9fbf-d8a15994c368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:47.808806 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369e00e-3c53-4685-9fbf-d8a15994c368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:47.811037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369e00e-3c53-4685-9fbf-d8a15994c368 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:47.824446 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1427/2871] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:49.346918 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a58db3-3063-4580-8c33-ba1d1447a07a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:49.348356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-47a58db3-3063-4580-8c33-ba1d1447a07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:49.355425 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:49.361729 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a58db3-3063-4580-8c33-ba1d1447a07a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:49.365649 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8aa2-41fe-435f-9e08-43fdbb47327d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:49.366340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8aa2-41fe-435f-9e08-43fdbb47327d service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:49.366623 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8aa2-41fe-435f-9e08-43fdbb47327d service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:49.366895 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8aa2-41fe-435f-9e08-43fdbb47327d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:49.429711 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd8aa2-41fe-435f-9e08-43fdbb47327d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:49.432033 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd8aa2-41fe-435f-9e08-43fdbb47327d service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:49.442492 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1445/2872] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:50.018269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369e00e-3c53-4685-9fbf-d8a15994c368 service cinder] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:50.027627 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369e00e-3c53-4685-9fbf-d8a15994c368 service cinder] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:50.031324 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e990c7a-bf6c-45c5-91b8-2e123a11c6f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:50.031977 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990c7a-bf6c-45c5-91b8-2e123a11c6f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:50.032257 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990c7a-bf6c-45c5-91b8-2e123a11c6f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:50.032531 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990c7a-bf6c-45c5-91b8-2e123a11c6f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:50.043242 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e990c7a-bf6c-45c5-91b8-2e123a11c6f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:50.044734 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e990c7a-bf6c-45c5-91b8-2e123a11c6f3 service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:50.055071 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1428/2873] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:09:53.946356 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8aa2-41fe-435f-9e08-43fdbb47327d service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:54.019096 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8aa2-41fe-435f-9e08-43fdbb47327d service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:54.023740 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:54.025222 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:54.025511 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:54.025790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] PATH_INFO: `/v3/users/d8616e61d0fd460d88cf91801e338ac4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:54.027148 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8616e61d0fd460d88cf91801e338ac4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:54.029077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:54.078128 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8616e61d0fd460d88cf91801e338ac4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.078808 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8616e61d0fd460d88cf91801e338ac4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.079428 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8616e61d0fd460d88cf91801e338ac4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.086652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8616e61d0fd460d88cf91801e338ac4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.094452 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8616e61d0fd460d88cf91801e338ac4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.112016 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1446/2874] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:53 2022] DELETE /identity/v3/users/d8616e61d0fd460d88cf91801e338ac4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:54.116780 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381cd9d-1b78-4a57-9084-3fe4d520064b None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:54.117269 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381cd9d-1b78-4a57-9084-3fe4d520064b None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:54.117424 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381cd9d-1b78-4a57-9084-3fe4d520064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:54.136406 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-4381cd9d-1b78-4a57-9084-3fe4d520064b None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:54.137631 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4381cd9d-1b78-4a57-9084-3fe4d520064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:54.200918 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1429/2875] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:54.210704 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:54.212233 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:54.236750 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:54.277713 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea98835-b4f4-4783-9862-f22a9d986098 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:54.281467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61fcef-5fed-490f-8f84-e1f4ed08173d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:54.282158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61fcef-5fed-490f-8f84-e1f4ed08173d service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:54.282446 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61fcef-5fed-490f-8f84-e1f4ed08173d service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:54.282717 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61fcef-5fed-490f-8f84-e1f4ed08173d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:54.293594 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61fcef-5fed-490f-8f84-e1f4ed08173d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:54.295085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61fcef-5fed-490f-8f84-e1f4ed08173d service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:54.305159 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1447/2876] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:54.599348 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381cd9d-1b78-4a57-9084-3fe4d520064b None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:54.600907 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-4381cd9d-1b78-4a57-9084-3fe4d520064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:54.617049 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381cd9d-1b78-4a57-9084-3fe4d520064b None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:54.622642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:54.623554 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:54.623839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:54.624124 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] PATH_INFO: `/v3/projects/93ec77fa6bb045258c464d64dd779690` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:54.625511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ec77fa6bb045258c464d64dd779690)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:54.627409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:54.676988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:54.683155 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ec77fa6bb045258c464d64dd779690', 'request_id': 'req-ef3b2f7f-7702-4199-b218-07932fdd095b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.690508 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ec77fa6bb045258c464d64dd779690', 'request_id': 'req-ef3b2f7f-7702-4199-b218-07932fdd095b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.697616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ec77fa6bb045258c464d64dd779690', 'request_id': 'req-ef3b2f7f-7702-4199-b218-07932fdd095b'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.708236 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] The token cache is being invalidate because project 93ec77fa6bb045258c464d64dd779690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:54.708449 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.709112 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.710751 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1430/2877] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:54 2022] DELETE /identity/v3/projects/93ec77fa6bb045258c464d64dd779690 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:54.715415 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61fcef-5fed-490f-8f84-e1f4ed08173d service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:54.725470 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61fcef-5fed-490f-8f84-e1f4ed08173d service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:54.785255 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:54.786166 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:54.786448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:54.786720 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] PATH_INFO: `/v3/users/a770d00cbebe4992ad4e443d9d2003e6` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:54.787936 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a770d00cbebe4992ad4e443d9d2003e6)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:54.789874 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:54.865471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a770d00cbebe4992ad4e443d9d2003e6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.866142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a770d00cbebe4992ad4e443d9d2003e6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.866922 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a770d00cbebe4992ad4e443d9d2003e6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.876112 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a770d00cbebe4992ad4e443d9d2003e6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.885471 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a770d00cbebe4992ad4e443d9d2003e6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:54.904773 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1448/2878] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:54 2022] DELETE /identity/v3/users/a770d00cbebe4992ad4e443d9d2003e6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:55.200393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:55.201911 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:55.217163 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b2f7f-7702-4199-b218-07932fdd095b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:55.282816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:55.283698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:55.283989 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:55.284280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] PATH_INFO: `/v3/projects/316b40e2e3ce485c93d222a6a9381a5a` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:55.285501 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=316b40e2e3ce485c93d222a6a9381a5a)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:55.287458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:55.336201 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316b40e2e3ce485c93d222a6a9381a5a', 'request_id': 'req-dbd307cf-d644-45af-a643-4ed2fde7ad21'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:55.345146 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316b40e2e3ce485c93d222a6a9381a5a', 'request_id': 'req-dbd307cf-d644-45af-a643-4ed2fde7ad21'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:55.351831 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316b40e2e3ce485c93d222a6a9381a5a', 'request_id': 'req-dbd307cf-d644-45af-a643-4ed2fde7ad21'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:55.362684 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] The token cache is being invalidate because project 316b40e2e3ce485c93d222a6a9381a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:55.362970 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:55.363621 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:55.365177 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1431/2879] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:55 2022] DELETE /identity/v3/projects/316b40e2e3ce485c93d222a6a9381a5a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:09:55.370120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:55.372305 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:55.392540 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488775d-0814-46ea-912e-5874947e815e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:55.439806 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:55.460693 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98432c93-7c5b-44ce-9454-58480312b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:55.461582 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98432c93-7c5b-44ce-9454-58480312b254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:55.461869 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98432c93-7c5b-44ce-9454-58480312b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:55.463202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98432c93-7c5b-44ce-9454-58480312b254 admin admin] PATH_INFO: `/v3/users/98e2e898db744b9899cfa3f5fd581495` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:55.464257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98432c93-7c5b-44ce-9454-58480312b254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e2e898db744b9899cfa3f5fd581495)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:55.466802 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98432c93-7c5b-44ce-9454-58480312b254 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:55.517904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-98432c93-7c5b-44ce-9454-58480312b254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e2e898db744b9899cfa3f5fd581495'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:55.518808 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-98432c93-7c5b-44ce-9454-58480312b254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e2e898db744b9899cfa3f5fd581495'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:55.519790 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-98432c93-7c5b-44ce-9454-58480312b254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e2e898db744b9899cfa3f5fd581495'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:55.528490 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-98432c93-7c5b-44ce-9454-58480312b254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e2e898db744b9899cfa3f5fd581495'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:55.536320 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-98432c93-7c5b-44ce-9454-58480312b254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e2e898db744b9899cfa3f5fd581495'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:55.555486 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1449/2880] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:55 2022] DELETE /identity/v3/users/98e2e898db744b9899cfa3f5fd581495 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:55.849789 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:55.851448 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:55.865008 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd307cf-d644-45af-a643-4ed2fde7ad21 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:55.925175 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:55.926085 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:55.926377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:55.926717 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] PATH_INFO: `/v3/projects/b2def4d2efc9454e9a6a51123cb15a61` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:55.927919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2def4d2efc9454e9a6a51123cb15a61)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:55.930396 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:55.933629 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:55.984121 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2def4d2efc9454e9a6a51123cb15a61', 'request_id': 'req-9cf7dc7f-f31e-484d-be96-55b656410d8a'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:55.991597 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2def4d2efc9454e9a6a51123cb15a61', 'request_id': 'req-9cf7dc7f-f31e-484d-be96-55b656410d8a'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:56.000012 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2def4d2efc9454e9a6a51123cb15a61', 'request_id': 'req-9cf7dc7f-f31e-484d-be96-55b656410d8a'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:56.012735 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] The token cache is being invalidate because project b2def4d2efc9454e9a6a51123cb15a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:56.013024 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:56.013698 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-9cf7dc7f-f31e-484d-be96-55b656410d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:56.015326 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1432/2881] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:55 2022] DELETE /identity/v3/projects/b2def4d2efc9454e9a6a51123cb15a61 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:56.020404 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96188ef3-04a7-42eb-a130-67d81e4202b3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.020629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96188ef3-04a7-42eb-a130-67d81e4202b3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.020906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96188ef3-04a7-42eb-a130-67d81e4202b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.043272 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-96188ef3-04a7-42eb-a130-67d81e4202b3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:56.044803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-96188ef3-04a7-42eb-a130-67d81e4202b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:56.108764 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1450/2882] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:56.116932 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9255f2c-51a9-47a2-b64c-ed02128e9e19 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.117228 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9255f2c-51a9-47a2-b64c-ed02128e9e19 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.117512 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9255f2c-51a9-47a2-b64c-ed02128e9e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.137488 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a9255f2c-51a9-47a2-b64c-ed02128e9e19 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:56.138790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a9255f2c-51a9-47a2-b64c-ed02128e9e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:56.149458 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1433/2883] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:56.154502 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96188ef3-04a7-42eb-a130-67d81e4202b3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:56.164686 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96188ef3-04a7-42eb-a130-67d81e4202b3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:56.170151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa188f-ffc0-4c9a-879c-b992bb013a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:56.170836 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa188f-ffc0-4c9a-879c-b992bb013a60 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.171117 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa188f-ffc0-4c9a-879c-b992bb013a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.171392 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa188f-ffc0-4c9a-879c-b992bb013a60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.172252 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa188f-ffc0-4c9a-879c-b992bb013a60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:09:56.172559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa188f-ffc0-4c9a-879c-b992bb013a60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:56.174183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa188f-ffc0-4c9a-879c-b992bb013a60 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:56.188595 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1451/2884] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:09:56.193107 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9255f2c-51a9-47a2-b64c-ed02128e9e19 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:56.203087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9255f2c-51a9-47a2-b64c-ed02128e9e19 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:56.208113 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ee7aa-df4a-4aed-ab2d-90a2e5984e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:56.208834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ee7aa-df4a-4aed-ab2d-90a2e5984e22 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.209083 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ee7aa-df4a-4aed-ab2d-90a2e5984e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.209360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ee7aa-df4a-4aed-ab2d-90a2e5984e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.210128 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ee7aa-df4a-4aed-ab2d-90a2e5984e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:56.212092 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ee7aa-df4a-4aed-ab2d-90a2e5984e22 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:56.241419 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1434/2885] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:56 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:56.247151 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa188f-ffc0-4c9a-879c-b992bb013a60 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:56.258192 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa188f-ffc0-4c9a-879c-b992bb013a60 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:56.305611 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:56.319820 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0122d6-ec15-4340-9f59-be9f99c2b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:56.320501 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0122d6-ec15-4340-9f59-be9f99c2b628 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.320782 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0122d6-ec15-4340-9f59-be9f99c2b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.321057 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0122d6-ec15-4340-9f59-be9f99c2b628 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.322178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0122d6-ec15-4340-9f59-be9f99c2b628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:56.324547 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0122d6-ec15-4340-9f59-be9f99c2b628 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:56.345652 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1452/2886] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:56 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:09:56.350093 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ee7aa-df4a-4aed-ab2d-90a2e5984e22 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:56.361377 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ee7aa-df4a-4aed-ab2d-90a2e5984e22 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:56.366152 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204619e-6822-4450-b4cc-ed8a1e86e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:56.367010 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204619e-6822-4450-b4cc-ed8a1e86e1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.367288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204619e-6822-4450-b4cc-ed8a1e86e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.367558 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204619e-6822-4450-b4cc-ed8a1e86e1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.368986 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204619e-6822-4450-b4cc-ed8a1e86e1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:56.370825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204619e-6822-4450-b4cc-ed8a1e86e1e4 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:56.382956 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1435/2887] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:56.386644 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0122d6-ec15-4340-9f59-be9f99c2b628 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:56.396828 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0122d6-ec15-4340-9f59-be9f99c2b628 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:56.402273 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887a3b4-4899-4598-8742-01e0fbc286fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:56.402949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a3b4-4899-4598-8742-01e0fbc286fe admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.403539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a3b4-4899-4598-8742-01e0fbc286fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.403539 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a3b4-4899-4598-8742-01e0fbc286fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.404214 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887a3b4-4899-4598-8742-01e0fbc286fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:56.405799 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887a3b4-4899-4598-8742-01e0fbc286fe admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:56.416812 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1453/2888] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:56.427761 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204619e-6822-4450-b4cc-ed8a1e86e1e4 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:56.439030 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204619e-6822-4450-b4cc-ed8a1e86e1e4 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:56.444051 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be783c-86eb-40b1-a3c0-c6e4f8b16231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:56.444953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be783c-86eb-40b1-a3c0-c6e4f8b16231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.445238 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be783c-86eb-40b1-a3c0-c6e4f8b16231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.445513 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be783c-86eb-40b1-a3c0-c6e4f8b16231 admin admin] PATH_INFO: `/v3/projects/88b2b7c150694885ae37bec51020e678/users/57a117d7b72f4c4d96e53dfd4fcfccfe/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.461005 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be783c-86eb-40b1-a3c0-c6e4f8b16231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b2b7c150694885ae37bec51020e678, user_id=57a117d7b72f4c4d96e53dfd4fcfccfe, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:56.464972 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be783c-86eb-40b1-a3c0-c6e4f8b16231 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:56.478839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1436/2889] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:56 2022] PUT /identity/v3/projects/88b2b7c150694885ae37bec51020e678/users/57a117d7b72f4c4d96e53dfd4fcfccfe/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:56.489754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0aa1e-aaf1-4ecb-9e0c-516c4397bae7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.490089 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0aa1e-aaf1-4ecb-9e0c-516c4397bae7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.490377 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0aa1e-aaf1-4ecb-9e0c-516c4397bae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.520107 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-03e0aa1e-aaf1-4ecb-9e0c-516c4397bae7 None None] MFA Rules not processed for user `57a117d7b72f4c4d96e53dfd4fcfccfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:56.521340 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-03e0aa1e-aaf1-4ecb-9e0c-516c4397bae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:56.588997 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1454/2890] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:56.600496 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be783c-86eb-40b1-a3c0-c6e4f8b16231 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:56.602323 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-43be783c-86eb-40b1-a3c0-c6e4f8b16231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:56.663790 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be783c-86eb-40b1-a3c0-c6e4f8b16231 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:56.668524 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e2c9f-080a-4d40-948d-d170d0b9f84f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c41347251cac48c3a2ee7fa6d2fe4cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:56.669182 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2c9f-080a-4d40-948d-d170d0b9f84f service cinder] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.669463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2c9f-080a-4d40-948d-d170d0b9f84f service cinder] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.669733 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2c9f-080a-4d40-948d-d170d0b9f84f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.678744 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e2c9f-080a-4d40-948d-d170d0b9f84f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:56.680190 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e2c9f-080a-4d40-948d-d170d0b9f84f service cinder] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:56.689723 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1437/2891] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:56.714941 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0aa1e-aaf1-4ecb-9e0c-516c4397bae7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:56.783754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0aa1e-aaf1-4ecb-9e0c-516c4397bae7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:56.789138 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:56.789435 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.789700 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.789858 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] PATH_INFO: `/v3/users/57a117d7b72f4c4d96e53dfd4fcfccfe` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.791400 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a117d7b72f4c4d96e53dfd4fcfccfe)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:56.795002 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:56.850195 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a117d7b72f4c4d96e53dfd4fcfccfe'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:56.850819 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a117d7b72f4c4d96e53dfd4fcfccfe'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:56.851432 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a117d7b72f4c4d96e53dfd4fcfccfe'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:56.860050 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a117d7b72f4c4d96e53dfd4fcfccfe'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:56.863085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:56.870190 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a117d7b72f4c4d96e53dfd4fcfccfe'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:56.890389 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1455/2892] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:56 2022] DELETE /identity/v3/users/57a117d7b72f4c4d96e53dfd4fcfccfe => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:56.894972 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e8f33-9299-4984-891a-d46b34cb399d None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:56.895263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e8f33-9299-4984-891a-d46b34cb399d None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:56.895544 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e8f33-9299-4984-891a-d46b34cb399d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:56.913395 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ff8e8f33-9299-4984-891a-d46b34cb399d None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:56.914644 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ff8e8f33-9299-4984-891a-d46b34cb399d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:56.943584 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:56.981813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1438/2893] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:56.991644 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:56.993050 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:57.059348 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8b1ab-4cda-419a-8c36-fa5b4ebf8a3a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:57.064982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cb68f-dfb1-480f-9176-32f0140456d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:57.066142 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cb68f-dfb1-480f-9176-32f0140456d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:57.066578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cb68f-dfb1-480f-9176-32f0140456d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:57.067039 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cb68f-dfb1-480f-9176-32f0140456d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:57.079634 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cb68f-dfb1-480f-9176-32f0140456d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:57.081084 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cb68f-dfb1-480f-9176-32f0140456d4 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:57.092524 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1456/2894] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:57.378839 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e8f33-9299-4984-891a-d46b34cb399d None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:57.380304 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ff8e8f33-9299-4984-891a-d46b34cb399d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:57.393037 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e8f33-9299-4984-891a-d46b34cb399d None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:57.400919 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:57.401602 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:57.401909 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:57.402179 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] PATH_INFO: `/v3/projects/88b2b7c150694885ae37bec51020e678` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:57.403445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b2b7c150694885ae37bec51020e678)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:57.405363 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:57.458404 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b2b7c150694885ae37bec51020e678', 'request_id': 'req-2329ecef-0916-4177-a2bd-7aea7a2c561e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:57.467208 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b2b7c150694885ae37bec51020e678', 'request_id': 'req-2329ecef-0916-4177-a2bd-7aea7a2c561e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:57.473813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b2b7c150694885ae37bec51020e678', 'request_id': 'req-2329ecef-0916-4177-a2bd-7aea7a2c561e'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:57.486337 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] The token cache is being invalidate because project 88b2b7c150694885ae37bec51020e678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:57.486685 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:57.487401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-2329ecef-0916-4177-a2bd-7aea7a2c561e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:57.489004 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1439/2895] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:57 2022] DELETE /identity/v3/projects/88b2b7c150694885ae37bec51020e678 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:57.494908 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55fcb-618d-4863-817c-2bc77fefc9be None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:57.495589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55fcb-618d-4863-817c-2bc77fefc9be None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:57.495589 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55fcb-618d-4863-817c-2bc77fefc9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:57.514709 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-96f55fcb-618d-4863-817c-2bc77fefc9be None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:57.515930 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-96f55fcb-618d-4863-817c-2bc77fefc9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:57.578085 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1457/2896] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:09:57.642560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2bef-8b5b-4db2-800e-6201344423f0 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:57.642765 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2bef-8b5b-4db2-800e-6201344423f0 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:57.643026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2bef-8b5b-4db2-800e-6201344423f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:57.664677 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-ffee2bef-8b5b-4db2-800e-6201344423f0 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:57.666533 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-ffee2bef-8b5b-4db2-800e-6201344423f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:57.674885 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1440/2897] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:57.680005 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f55fcb-618d-4863-817c-2bc77fefc9be None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:57.694385 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f55fcb-618d-4863-817c-2bc77fefc9be None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:57.699837 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfe772-a680-4574-ab81-d6004d6bafad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:57.700518 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfe772-a680-4574-ab81-d6004d6bafad admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:57.700803 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfe772-a680-4574-ab81-d6004d6bafad admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:57.701080 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfe772-a680-4574-ab81-d6004d6bafad admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:57.701816 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfe772-a680-4574-ab81-d6004d6bafad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:09:57.702160 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfe772-a680-4574-ab81-d6004d6bafad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:57.703781 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfe772-a680-4574-ab81-d6004d6bafad admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:57.716287 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1458/2898] 10.222.0.81 () {58 vars in 1152 bytes} [Thu Jun 16 15:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:09:57.721022 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee2bef-8b5b-4db2-800e-6201344423f0 None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:57.731268 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee2bef-8b5b-4db2-800e-6201344423f0 None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:57.736064 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e87f7-f45d-46e3-9955-7a862d32455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:57.736731 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e87f7-f45d-46e3-9955-7a862d32455f admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:57.737014 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e87f7-f45d-46e3-9955-7a862d32455f admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:57.737288 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e87f7-f45d-46e3-9955-7a862d32455f admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:57.738047 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e87f7-f45d-46e3-9955-7a862d32455f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:57.739939 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e87f7-f45d-46e3-9955-7a862d32455f admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:57.772408 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1441/2899] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:57 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:57.776241 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfe772-a680-4574-ab81-d6004d6bafad admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:57.787237 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfe772-a680-4574-ab81-d6004d6bafad admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:57.849532 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957df59-d6a4-42ce-80b5-0f22747f9a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:57.850325 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957df59-d6a4-42ce-80b5-0f22747f9a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:57.850605 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957df59-d6a4-42ce-80b5-0f22747f9a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:57.851070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957df59-d6a4-42ce-80b5-0f22747f9a29 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:57.851775 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957df59-d6a4-42ce-80b5-0f22747f9a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:57.854225 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957df59-d6a4-42ce-80b5-0f22747f9a29 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:57.864240 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:57.877118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1459/2900] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:57 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:57.881185 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e87f7-f45d-46e3-9955-7a862d32455f admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:57.893662 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e87f7-f45d-46e3-9955-7a862d32455f admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:57.899689 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef06aec-2836-4c0e-9936-847317dd7fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:57.900750 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef06aec-2836-4c0e-9936-847317dd7fec admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:57.901033 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef06aec-2836-4c0e-9936-847317dd7fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:57.901310 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef06aec-2836-4c0e-9936-847317dd7fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:57.902072 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef06aec-2836-4c0e-9936-847317dd7fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:57.904642 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef06aec-2836-4c0e-9936-847317dd7fec admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:57.917535 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1442/2901] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:09:57.924789 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957df59-d6a4-42ce-80b5-0f22747f9a29 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:57.935973 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957df59-d6a4-42ce-80b5-0f22747f9a29 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:57.940933 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c54642-6686-4cbf-a70d-d423d9274c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:57.941655 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c54642-6686-4cbf-a70d-d423d9274c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:57.941978 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c54642-6686-4cbf-a70d-d423d9274c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:57.942257 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c54642-6686-4cbf-a70d-d423d9274c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:57.942984 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c54642-6686-4cbf-a70d-d423d9274c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:57.944591 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c54642-6686-4cbf-a70d-d423d9274c16 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:57.958541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1460/2902] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:09:57.960263 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef06aec-2836-4c0e-9936-847317dd7fec admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:57.972615 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef06aec-2836-4c0e-9936-847317dd7fec admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:57.977403 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fc261-d375-41b4-a07b-f9509558c048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:57.979251 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc261-d375-41b4-a07b-f9509558c048 admin admin] REQUEST_METHOD: `PUT` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:57.979541 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc261-d375-41b4-a07b-f9509558c048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:57.979816 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc261-d375-41b4-a07b-f9509558c048 admin admin] PATH_INFO: `/v3/projects/e373dc0caae94eceaa0eaad012d20be5/users/dfceedb50bfe4a9f8773fb9b29ce3908/roles/764ea3c1356843bca6a7e706c6ba9a20` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:57.995226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fc261-d375-41b4-a07b-f9509558c048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e373dc0caae94eceaa0eaad012d20be5, user_id=dfceedb50bfe4a9f8773fb9b29ce3908, role_id=764ea3c1356843bca6a7e706c6ba9a20)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:57.997962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fc261-d375-41b4-a07b-f9509558c048 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:58.012018 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1443/2903] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:57 2022] PUT /identity/v3/projects/e373dc0caae94eceaa0eaad012d20be5/users/dfceedb50bfe4a9f8773fb9b29ce3908/roles/764ea3c1356843bca6a7e706c6ba9a20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:58.017143 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc5a41-5c18-4feb-b93f-0ccc435fc0a3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:58.017436 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc5a41-5c18-4feb-b93f-0ccc435fc0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:58.017719 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc5a41-5c18-4feb-b93f-0ccc435fc0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:58.037000 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-07dc5a41-5c18-4feb-b93f-0ccc435fc0a3 None None] MFA Rules not processed for user `196de148ea764c458b8dc4b5fcb67ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:58.038282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-07dc5a41-5c18-4feb-b93f-0ccc435fc0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:58.101870 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1461/2904] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:58.113105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fc261-d375-41b4-a07b-f9509558c048 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:58.114825 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-3c4fc261-d375-41b4-a07b-f9509558c048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:58.179231 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fc261-d375-41b4-a07b-f9509558c048 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:58.183387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c6ca6-e1a5-43b5-befa-06ecf8e335f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:58.184048 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c6ca6-e1a5-43b5-befa-06ecf8e335f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:58.184327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c6ca6-e1a5-43b5-befa-06ecf8e335f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:58.184626 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c6ca6-e1a5-43b5-befa-06ecf8e335f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:58.190758 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:58.195829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c6ca6-e1a5-43b5-befa-06ecf8e335f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:58.197626 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c6ca6-e1a5-43b5-befa-06ecf8e335f3 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:58.208958 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1444/2905] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:02.373229 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb686-c8fb-4701-bfbc-bfe01dc04322 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:02.374158 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb686-c8fb-4701-bfbc-bfe01dc04322 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:02.374669 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb686-c8fb-4701-bfbc-bfe01dc04322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:02.409597 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3e5bb686-c8fb-4701-bfbc-bfe01dc04322 None None] MFA Rules not processed for user `dfceedb50bfe4a9f8773fb9b29ce3908`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:02.410875 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3e5bb686-c8fb-4701-bfbc-bfe01dc04322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:02.487349 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1462/2906] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:10:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:02.492617 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c6ca6-e1a5-43b5-befa-06ecf8e335f3 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:02.503232 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c6ca6-e1a5-43b5-befa-06ecf8e335f3 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:02.508386 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bf562-ca55-4fec-bebf-1d3aef81ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:02.509142 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf562-ca55-4fec-bebf-1d3aef81ef93 admin admin] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:02.509514 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf562-ca55-4fec-bebf-1d3aef81ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:02.509813 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf562-ca55-4fec-bebf-1d3aef81ef93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:02.510774 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bf562-ca55-4fec-bebf-1d3aef81ef93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:02.512704 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bf562-ca55-4fec-bebf-1d3aef81ef93 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:02.545929 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1445/2907] 10.222.0.81 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:02 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:02.550105 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bb686-c8fb-4701-bfbc-bfe01dc04322 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:02.561564 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bb686-c8fb-4701-bfbc-bfe01dc04322 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:02.624716 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0190f-6146-41bc-aeb3-792ef690367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:02.625398 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0190f-6146-41bc-aeb3-792ef690367d admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:02.625683 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0190f-6146-41bc-aeb3-792ef690367d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:02.625992 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0190f-6146-41bc-aeb3-792ef690367d admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:02.626727 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0190f-6146-41bc-aeb3-792ef690367d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:02.628621 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0190f-6146-41bc-aeb3-792ef690367d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:02.658745 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1463/2908] 10.222.0.81 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:02 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:02.667361 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bf562-ca55-4fec-bebf-1d3aef81ef93 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:02.678394 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bf562-ca55-4fec-bebf-1d3aef81ef93 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:02.683999 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53167ba-1707-44e4-bc27-7de12dea257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:02.684671 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53167ba-1707-44e4-bc27-7de12dea257b admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:02.684988 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53167ba-1707-44e4-bc27-7de12dea257b admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:02.685291 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53167ba-1707-44e4-bc27-7de12dea257b admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:02.686047 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53167ba-1707-44e4-bc27-7de12dea257b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:02.687701 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53167ba-1707-44e4-bc27-7de12dea257b admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:02.701433 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1446/2909] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:02.705841 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0190f-6146-41bc-aeb3-792ef690367d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:02.712661 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:02.717843 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0190f-6146-41bc-aeb3-792ef690367d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:02.724064 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c14688-a2ef-4e3d-9072-d1194b6f6cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:02.724978 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c14688-a2ef-4e3d-9072-d1194b6f6cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:02.725260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c14688-a2ef-4e3d-9072-d1194b6f6cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:02.725533 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c14688-a2ef-4e3d-9072-d1194b6f6cb2 admin admin] PATH_INFO: `/v3/projects/e94ff836fc0645089205e058a4176e31/users/c7a49ec9162f4efe9cd57fe7013b7717/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:02.742315 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c14688-a2ef-4e3d-9072-d1194b6f6cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94ff836fc0645089205e058a4176e31, user_id=c7a49ec9162f4efe9cd57fe7013b7717, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:02.745153 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c14688-a2ef-4e3d-9072-d1194b6f6cb2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:02.760011 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1464/2910] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:02 2022] PUT /identity/v3/projects/e94ff836fc0645089205e058a4176e31/users/c7a49ec9162f4efe9cd57fe7013b7717/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:02.764414 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53167ba-1707-44e4-bc27-7de12dea257b admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:02.778568 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53167ba-1707-44e4-bc27-7de12dea257b admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:02.855366 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79be133-81d1-4f84-ae82-dc828e44f804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:02.856087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79be133-81d1-4f84-ae82-dc828e44f804 admin admin] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:02.856372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79be133-81d1-4f84-ae82-dc828e44f804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:02.856674 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79be133-81d1-4f84-ae82-dc828e44f804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:02.857408 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79be133-81d1-4f84-ae82-dc828e44f804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:02.859246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79be133-81d1-4f84-ae82-dc828e44f804 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:02.872741 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1447/2911] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:02.878408 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c14688-a2ef-4e3d-9072-d1194b6f6cb2 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:02.889684 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c14688-a2ef-4e3d-9072-d1194b6f6cb2 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:02.894481 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5006f79-0cee-4805-a98d-f9b0216c316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:02.895409 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006f79-0cee-4805-a98d-f9b0216c316c admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:02.895688 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006f79-0cee-4805-a98d-f9b0216c316c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:02.895962 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006f79-0cee-4805-a98d-f9b0216c316c admin admin] PATH_INFO: `/v3/projects/e94ff836fc0645089205e058a4176e31/users/c7a49ec9162f4efe9cd57fe7013b7717/roles/75d02feb522f48b696d82c55d87d9b23` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:02.898299 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5006f79-0cee-4805-a98d-f9b0216c316c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94ff836fc0645089205e058a4176e31, user_id=c7a49ec9162f4efe9cd57fe7013b7717, role_id=75d02feb522f48b696d82c55d87d9b23)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:02.902197 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5006f79-0cee-4805-a98d-f9b0216c316c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:02.918163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1465/2912] 10.222.0.81 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:02 2022] PUT /identity/v3/projects/e94ff836fc0645089205e058a4176e31/users/c7a49ec9162f4efe9cd57fe7013b7717/roles/75d02feb522f48b696d82c55d87d9b23 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:08.219141 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b392e-fb77-4a7c-8086-a124f1202483 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:08.219739 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b392e-fb77-4a7c-8086-a124f1202483 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:08.219850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b392e-fb77-4a7c-8086-a124f1202483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:08.252876 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-a67b392e-fb77-4a7c-8086-a124f1202483 None None] MFA Rules not processed for user `c7a49ec9162f4efe9cd57fe7013b7717`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:08.254235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a67b392e-fb77-4a7c-8086-a124f1202483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:08.345489 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1448/2913] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:10:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:08.359178 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5006f79-0cee-4805-a98d-f9b0216c316c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:08.361083 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b5006f79-0cee-4805-a98d-f9b0216c316c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:08.453919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5006f79-0cee-4805-a98d-f9b0216c316c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:08.460853 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6b6f0-fb19-4c8f-929f-d72a7bd7f9de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9c1cc51e544c90a629feb312a80c71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:08.462118 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6b6f0-fb19-4c8f-929f-d72a7bd7f9de service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:08.462822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6b6f0-fb19-4c8f-929f-d72a7bd7f9de service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:08.462822 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6b6f0-fb19-4c8f-929f-d72a7bd7f9de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:08.526410 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6b6f0-fb19-4c8f-929f-d72a7bd7f9de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:08.527849 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6b6f0-fb19-4c8f-929f-d72a7bd7f9de service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:08.537964 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1466/2914] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:08.641217 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d239fd-003a-4b28-a192-2875d5fb5126 None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:08.641506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d239fd-003a-4b28-a192-2875d5fb5126 None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:08.641785 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d239fd-003a-4b28-a192-2875d5fb5126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:08.713905 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-c3d239fd-003a-4b28-a192-2875d5fb5126 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:08.715178 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c3d239fd-003a-4b28-a192-2875d5fb5126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:08.719738 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:08.809200 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1449/2915] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 15:10:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:08.860235 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6b6f0-fb19-4c8f-929f-d72a7bd7f9de service glance] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:08.862613 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1cd6b6f0-fb19-4c8f-929f-d72a7bd7f9de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:08.944260 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:08.978626 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6b6f0-fb19-4c8f-929f-d72a7bd7f9de service glance] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:08.984049 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bf8ce-2fea-449e-9036-39b628b71c3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:08.984891 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bf8ce-2fea-449e-9036-39b628b71c3e service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:08.985362 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bf8ce-2fea-449e-9036-39b628b71c3e service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:08.985646 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bf8ce-2fea-449e-9036-39b628b71c3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:08.995798 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bf8ce-2fea-449e-9036-39b628b71c3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:08.997570 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bf8ce-2fea-449e-9036-39b628b71c3e service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:09.009243 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1467/2916] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 15:10:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:10:17.798654 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca74ba-9b80-4472-991f-e0121656eece None None] REQUEST_METHOD: `POST` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:17.799235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca74ba-9b80-4472-991f-e0121656eece None None] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:17.799235 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca74ba-9b80-4472-991f-e0121656eece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:17.817365 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.auth.core [None req-b6ca74ba-9b80-4472-991f-e0121656eece None None] MFA Rules not processed for user `dfceedb50bfe4a9f8773fb9b29ce3908`. Rule list: `[]` (Enabled: `True`). {{(pid=80108) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:17.818639 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b6ca74ba-9b80-4472-991f-e0121656eece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:17.826649 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1450/2917] 10.222.0.81 () {58 vars in 957 bytes} [Thu Jun 16 15:10:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:18.093438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bf8ce-2fea-449e-9036-39b628b71c3e service swift] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:18.152929 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bf8ce-2fea-449e-9036-39b628b71c3e service swift] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:18.156467 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915e53b-979d-4a46-a9a8-3f7b13f5c0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:18.157120 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e53b-979d-4a46-a9a8-3f7b13f5c0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:18.157395 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e53b-979d-4a46-a9a8-3f7b13f5c0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:18.157672 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e53b-979d-4a46-a9a8-3f7b13f5c0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:18.159491 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8915e53b-979d-4a46-a9a8-3f7b13f5c0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:18.169982 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915e53b-979d-4a46-a9a8-3f7b13f5c0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:18.171421 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915e53b-979d-4a46-a9a8-3f7b13f5c0e2 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:18.179702 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1468/2918] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:18.501676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca74ba-9b80-4472-991f-e0121656eece None None] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:18.503290 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-b6ca74ba-9b80-4472-991f-e0121656eece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:18.586736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca74ba-9b80-4472-991f-e0121656eece None None] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:18.592355 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3534903-9e6a-43c9-9813-fee8ea7db118 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:18.593026 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534903-9e6a-43c9-9813-fee8ea7db118 service placement] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:18.593307 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534903-9e6a-43c9-9813-fee8ea7db118 service placement] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:18.593583 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534903-9e6a-43c9-9813-fee8ea7db118 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:18.595401 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-e3534903-9e6a-43c9-9813-fee8ea7db118 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:18.610560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3534903-9e6a-43c9-9813-fee8ea7db118 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:18.612169 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3534903-9e6a-43c9-9813-fee8ea7db118 service placement] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:18.624034 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1451/2919] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:20.076333 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc1687-3c00-465a-ac9a-9c457b6ff843 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:20.076847 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc1687-3c00-465a-ac9a-9c457b6ff843 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:20.076949 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc1687-3c00-465a-ac9a-9c457b6ff843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:20.095401 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b4bc1687-3c00-465a-ac9a-9c457b6ff843 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:20.096631 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b4bc1687-3c00-465a-ac9a-9c457b6ff843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:20.105833 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1469/2920] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Jun 16 15:10:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:20.118010 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3534903-9e6a-43c9-9813-fee8ea7db118 service placement] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:20.130848 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3534903-9e6a-43c9-9813-fee8ea7db118 service placement] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:20.137385 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e93fa-8c59-4cd9-860a-8c6a9272db4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:20.138358 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e93fa-8c59-4cd9-860a-8c6a9272db4a service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:20.138720 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e93fa-8c59-4cd9-860a-8c6a9272db4a service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:20.139105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e93fa-8c59-4cd9-860a-8c6a9272db4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:20.148422 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e93fa-8c59-4cd9-860a-8c6a9272db4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:20.150867 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e93fa-8c59-4cd9-860a-8c6a9272db4a service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:20.160179 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1452/2921] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 15:10:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:10:27.911800 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc1687-3c00-465a-ac9a-9c457b6ff843 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:27.913301 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b4bc1687-3c00-465a-ac9a-9c457b6ff843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:27.925282 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc1687-3c00-465a-ac9a-9c457b6ff843 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:27.928844 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3730f3-2e70-42e9-849f-2402f5fdece7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:27.930056 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3730f3-2e70-42e9-849f-2402f5fdece7 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:27.930343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3730f3-2e70-42e9-849f-2402f5fdece7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:27.930701 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3730f3-2e70-42e9-849f-2402f5fdece7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:27.932718 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6b3730f3-2e70-42e9-849f-2402f5fdece7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:28.031578 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3730f3-2e70-42e9-849f-2402f5fdece7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:28.033025 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3730f3-2e70-42e9-849f-2402f5fdece7 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:28.055938 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1470/2922] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:29.247325 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e93fa-8c59-4cd9-860a-8c6a9272db4a service swift] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:29.261834 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e93fa-8c59-4cd9-860a-8c6a9272db4a service swift] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:29.265695 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153d14a-2351-41d6-845e-7d86ccccda8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:29.266390 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153d14a-2351-41d6-845e-7d86ccccda8f service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:29.266676 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153d14a-2351-41d6-845e-7d86ccccda8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:29.266951 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153d14a-2351-41d6-845e-7d86ccccda8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:29.268764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-a153d14a-2351-41d6-845e-7d86ccccda8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:29.283566 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153d14a-2351-41d6-845e-7d86ccccda8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:29.285011 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153d14a-2351-41d6-845e-7d86ccccda8f service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:29.298148 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1453/2923] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:38.052081 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=85 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:39.292590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=75 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:39.430754 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3730f3-2e70-42e9-849f-2402f5fdece7 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:39.432199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6b3730f3-2e70-42e9-849f-2402f5fdece7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:39.451129 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3730f3-2e70-42e9-849f-2402f5fdece7 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:39.459212 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59812a4e-71e2-47ae-ac22-35c9381cb167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:39.459904 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59812a4e-71e2-47ae-ac22-35c9381cb167 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:39.460180 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59812a4e-71e2-47ae-ac22-35c9381cb167 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:39.460455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59812a4e-71e2-47ae-ac22-35c9381cb167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:39.463079 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-59812a4e-71e2-47ae-ac22-35c9381cb167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:39.476170 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59812a4e-71e2-47ae-ac22-35c9381cb167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:39.478629 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59812a4e-71e2-47ae-ac22-35c9381cb167 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:39.490183 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1471/2924] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:47.384881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153d14a-2351-41d6-845e-7d86ccccda8f service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:47.393804 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153d14a-2351-41d6-845e-7d86ccccda8f service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:47.397527 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd28d6-5f8d-4e65-9e37-ca73c112dca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:47.398302 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd28d6-5f8d-4e65-9e37-ca73c112dca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:47.398990 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd28d6-5f8d-4e65-9e37-ca73c112dca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:47.399280 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd28d6-5f8d-4e65-9e37-ca73c112dca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:47.408959 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd28d6-5f8d-4e65-9e37-ca73c112dca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:47.410511 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd28d6-5f8d-4e65-9e37-ca73c112dca7 service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:47.421241 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1454/2925] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:49.116559 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59812a4e-71e2-47ae-ac22-35c9381cb167 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:49.119136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-59812a4e-71e2-47ae-ac22-35c9381cb167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:49.136541 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59812a4e-71e2-47ae-ac22-35c9381cb167 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:49.143919 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26caa3c-9804-4ab3-8d76-1b0b4aa8185a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:49.144601 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26caa3c-9804-4ab3-8d76-1b0b4aa8185a service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:49.144912 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26caa3c-9804-4ab3-8d76-1b0b4aa8185a service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:49.145189 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26caa3c-9804-4ab3-8d76-1b0b4aa8185a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:49.147077 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e26caa3c-9804-4ab3-8d76-1b0b4aa8185a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:49.160772 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26caa3c-9804-4ab3-8d76-1b0b4aa8185a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:49.162416 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26caa3c-9804-4ab3-8d76-1b0b4aa8185a service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:49.174163 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1472/2926] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:57.416846 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=6 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:59.169238 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=12 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:15.735771 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd28d6-5f8d-4e65-9e37-ca73c112dca7 service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:15.745017 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd28d6-5f8d-4e65-9e37-ca73c112dca7 service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:15.748667 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a898ca-60c0-49ff-9ae1-e1d692909d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8940bddd49534f01a8b1bf1dee644216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:15.749314 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a898ca-60c0-49ff-9ae1-e1d692909d3c service neutron] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:15.749601 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a898ca-60c0-49ff-9ae1-e1d692909d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:15.749915 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a898ca-60c0-49ff-9ae1-e1d692909d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:15.751707 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-68a898ca-60c0-49ff-9ae1-e1d692909d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:15.762376 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a898ca-60c0-49ff-9ae1-e1d692909d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:15.763800 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a898ca-60c0-49ff-9ae1-e1d692909d3c service neutron] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:15.771850 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1455/2927] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:25.768227 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=6 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:50.239722 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26caa3c-9804-4ab3-8d76-1b0b4aa8185a service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:50.252216 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26caa3c-9804-4ab3-8d76-1b0b4aa8185a service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:50.259070 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8570f-9906-42ee-9e9c-03ebbb11473b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2faa046b0294a0ba1090be84bb1cebc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:50.259735 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8570f-9906-42ee-9e9c-03ebbb11473b service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:50.260021 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8570f-9906-42ee-9e9c-03ebbb11473b service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:50.260297 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8570f-9906-42ee-9e9c-03ebbb11473b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:50.262455 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cda8570f-9906-42ee-9e9c-03ebbb11473b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:50.275705 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8570f-9906-42ee-9e9c-03ebbb11473b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:50.277305 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8570f-9906-42ee-9e9c-03ebbb11473b service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:50.288358 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1473/2928] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:50.425551 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a898ca-60c0-49ff-9ae1-e1d692909d3c service neutron] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:50.427409 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-68a898ca-60c0-49ff-9ae1-e1d692909d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:50.445736 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a898ca-60c0-49ff-9ae1-e1d692909d3c service neutron] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:50.450912 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b1c32-3faa-4cb9-9e3f-a424fc1304a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:50.451592 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b1c32-3faa-4cb9-9e3f-a424fc1304a7 service placement] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:50.451872 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b1c32-3faa-4cb9-9e3f-a424fc1304a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:50.452145 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b1c32-3faa-4cb9-9e3f-a424fc1304a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:50.453916 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-2c1b1c32-3faa-4cb9-9e3f-a424fc1304a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:50.466156 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b1c32-3faa-4cb9-9e3f-a424fc1304a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:50.467753 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b1c32-3faa-4cb9-9e3f-a424fc1304a7 service placement] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:50.478463 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1456/2929] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:52.850068 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95552-4597-44f9-b9cc-20ec85940c79 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:52.851091 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95552-4597-44f9-b9cc-20ec85940c79 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:52.851207 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95552-4597-44f9-b9cc-20ec85940c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:52.869777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b2b95552-4597-44f9-b9cc-20ec85940c79 None None] MFA Rules not processed for user `7255df373d794cf8b2548b3c0876dd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:13:52.870995 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b2b95552-4597-44f9-b9cc-20ec85940c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:52.878399 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1474/2930] 10.222.0.81 () {58 vars in 967 bytes} [Thu Jun 16 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:13:52.921560 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b1c32-3faa-4cb9-9e3f-a424fc1304a7 service placement] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:52.935031 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b1c32-3faa-4cb9-9e3f-a424fc1304a7 service placement] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:52.940130 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44dd46-c2fd-4fee-8127-06594a3d1102 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0e6fc45641f4c279def2d4aa971978d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:52.940817 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44dd46-c2fd-4fee-8127-06594a3d1102 service swift] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:52.941105 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44dd46-c2fd-4fee-8127-06594a3d1102 service swift] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:52.941387 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44dd46-c2fd-4fee-8127-06594a3d1102 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:52.950221 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44dd46-c2fd-4fee-8127-06594a3d1102 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:52.951824 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44dd46-c2fd-4fee-8127-06594a3d1102 service swift] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:52.960854 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1457/2931] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Jun 16 15:13:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:13:56.513438 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95552-4597-44f9-b9cc-20ec85940c79 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:56.533439 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95552-4597-44f9-b9cc-20ec85940c79 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:56.539777 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0d1cd-4764-4a38-a54d-1bc16431da86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:56.540906 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d1cd-4764-4a38-a54d-1bc16431da86 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:56.541373 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d1cd-4764-4a38-a54d-1bc16431da86 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:56.541674 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d1cd-4764-4a38-a54d-1bc16431da86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:56.543596 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-caa0d1cd-4764-4a38-a54d-1bc16431da86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:56.558744 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0d1cd-4764-4a38-a54d-1bc16431da86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:56.561462 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0d1cd-4764-4a38-a54d-1bc16431da86 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:56.574202 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1475/2932] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:59.917126 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44dd46-c2fd-4fee-8127-06594a3d1102 service swift] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:59.929267 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44dd46-c2fd-4fee-8127-06594a3d1102 service swift] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:59.934360 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742af19-5043-4802-8b6f-514af02b2188 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:59.935362 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742af19-5043-4802-8b6f-514af02b2188 service placement] REQUEST_METHOD: `GET` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:59.935965 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742af19-5043-4802-8b6f-514af02b2188 service placement] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:59.936246 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742af19-5043-4802-8b6f-514af02b2188 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:59.938087 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-f742af19-5043-4802-8b6f-514af02b2188 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:59.951220 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742af19-5043-4802-8b6f-514af02b2188 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:59.952802 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742af19-5043-4802-8b6f-514af02b2188 service placement] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:59.963962 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1458/2933] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:59.986625 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0d1cd-4764-4a38-a54d-1bc16431da86 service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:00.054885 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0d1cd-4764-4a38-a54d-1bc16431da86 service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:00.059446 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:00.060333 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:00.060618 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:00.060893 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] PATH_INFO: `/v3/users/dfceedb50bfe4a9f8773fb9b29ce3908` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:00.062167 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfceedb50bfe4a9f8773fb9b29ce3908)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:00.064092 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:00.115161 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfceedb50bfe4a9f8773fb9b29ce3908'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.116516 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfceedb50bfe4a9f8773fb9b29ce3908'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.117136 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfceedb50bfe4a9f8773fb9b29ce3908'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.124294 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfceedb50bfe4a9f8773fb9b29ce3908'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.132932 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfceedb50bfe4a9f8773fb9b29ce3908'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.150774 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1476/2934] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:13:59 2022] DELETE /identity/v3/users/dfceedb50bfe4a9f8773fb9b29ce3908 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:14:00.338439 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742af19-5043-4802-8b6f-514af02b2188 service placement] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:00.350829 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742af19-5043-4802-8b6f-514af02b2188 service placement] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:00.421864 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:00.422764 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:00.423046 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:00.423319 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] PATH_INFO: `/v3/projects/e373dc0caae94eceaa0eaad012d20be5` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:00.424512 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e373dc0caae94eceaa0eaad012d20be5)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:00.426506 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:00.489372 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e373dc0caae94eceaa0eaad012d20be5', 'request_id': 'req-c3a27919-d1a1-479a-8022-b7f562add112'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.499300 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e373dc0caae94eceaa0eaad012d20be5', 'request_id': 'req-c3a27919-d1a1-479a-8022-b7f562add112'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.506364 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e373dc0caae94eceaa0eaad012d20be5', 'request_id': 'req-c3a27919-d1a1-479a-8022-b7f562add112'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.518327 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] The token cache is being invalidate because project e373dc0caae94eceaa0eaad012d20be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:14:00.518616 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.519295 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.520881 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1459/2935] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:14:00 2022] DELETE /identity/v3/projects/e373dc0caae94eceaa0eaad012d20be5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:14:00.526733 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:00.528281 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:00.542308 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d5656-3187-4d9c-ad83-276fca40823f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:00.589326 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:00.609448 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:00.610856 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:00.611316 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:00.611769 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] PATH_INFO: `/v3/users/c7a49ec9162f4efe9cd57fe7013b7717` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:00.613738 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7a49ec9162f4efe9cd57fe7013b7717)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:00.617168 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:00.680879 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7a49ec9162f4efe9cd57fe7013b7717'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.681664 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7a49ec9162f4efe9cd57fe7013b7717'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.682497 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7a49ec9162f4efe9cd57fe7013b7717'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.690210 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7a49ec9162f4efe9cd57fe7013b7717'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.697734 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7a49ec9162f4efe9cd57fe7013b7717'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:00.715797 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1477/2936] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jun 16 15:14:00 2022] DELETE /identity/v3/users/c7a49ec9162f4efe9cd57fe7013b7717 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:14:00.899953 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] Authenticating user token {{(pid=80108) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:00.901474 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.fernet_utils [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80108) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:00.916927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a27919-d1a1-479a-8022-b7f562add112 admin admin] Validating token access rules against request {{(pid=80108) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:00.979393 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:00.997254 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196de148ea764c458b8dc4b5fcb67ec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4e16df5d3ec4c65bc803e3fc067e3c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80108) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:00.998590 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:00.998927 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:00.999320 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] PATH_INFO: `/v3/projects/e94ff836fc0645089205e058a4176e31` {{(pid=80108) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:01.000982 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94ff836fc0645089205e058a4176e31)` {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:01.003645 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] RBAC: Authorization granted {{(pid=80108) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:01.085207 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94ff836fc0645089205e058a4176e31', 'request_id': 'req-1cbeaad1-6ddb-4013-b757-65507d263044'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:01.096116 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94ff836fc0645089205e058a4176e31', 'request_id': 'req-1cbeaad1-6ddb-4013-b757-65507d263044'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:01.106391 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94ff836fc0645089205e058a4176e31', 'request_id': 'req-1cbeaad1-6ddb-4013-b757-65507d263044'} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:01.120703 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] The token cache is being invalidate because project e94ff836fc0645089205e058a4176e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80108) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:14:01.120998 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:01.121655 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG keystone.notifications [None req-1cbeaad1-6ddb-4013-b757-65507d263044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80108) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:01.123226 dv-cinder-837353-2-smb devstack@keystone.service[80108]: [pid: 80108|app: 0|req: 1460/2937] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jun 16 15:14:00 2022] DELETE /identity/v3/projects/e94ff836fc0645089205e058a4176e31 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:14:10.712199 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:11.117445 dv-cinder-837353-2-smb devstack@keystone.service[80108]: DEBUG dbcounter [-] [80108] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:19:12.110866 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:19:12.112278 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:19:12.253696 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d727e1-bc4a-4d1c-a538-dd2d770b69c1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:19:12.315363 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109941ec-97d4-4945-bcd8-16706bf97838 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57eebea8e2f6424d805d9b84c222b222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d5d9f5e8214467bbeee29fb92bb79e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:19:12.316008 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109941ec-97d4-4945-bcd8-16706bf97838 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:19:12.316290 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109941ec-97d4-4945-bcd8-16706bf97838 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:19:12.316563 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109941ec-97d4-4945-bcd8-16706bf97838 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:19:12.318379 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-109941ec-97d4-4945-bcd8-16706bf97838 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:19:12.329747 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109941ec-97d4-4945-bcd8-16706bf97838 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:19:12.331343 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109941ec-97d4-4945-bcd8-16706bf97838 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:19:12.342069 dv-cinder-837353-2-smb devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1478/2938] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Jun 16 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:19:22.337350 dv-cinder-837353-2-smb devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}